You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@eagle.apache.org by mw...@apache.org on 2016/08/01 06:27:07 UTC
svn commit: r1754706 [2/4] - in /incubator/eagle/site: ./ about/ docs/
docs/tutorial/ images/docs/ post/2015/10/27/
Modified: incubator/eagle/site/docs/hdfs-data-activity-monitoring.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/hdfs-data-activity-monitoring.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/hdfs-data-activity-monitoring.html (original)
+++ incubator/eagle/site/docs/hdfs-data-activity-monitoring.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/hdfs-data-activity-monitoring.html" id="">Policy Management</a></li>
@@ -237,7 +239,7 @@
<li>
<p><strong>Step 1</strong>: Configure Advanced hdfs-log4j via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, by adding below “KAFKA_HDFS_AUDIT” log4j appender to hdfs audit logging.</p>
- <pre><code> log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <div class="highlighter-rouge"><pre class="highlight"><code> log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -245,22 +247,25 @@
log4j.appender.KAFKA_HDFS_AUDIT.Layout.ConversionPattern=%d{ISO8601} %p %c{2}: %m%n
log4j.appender.KAFKA_HDFS_AUDIT.ProducerType=async
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 2</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p>
- <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit Advanced hadoop-env via <a href="http://localhost:8080/#/main/services/HDFS/configs" target="_blank">Ambari UI</a>, and append the following command to it.</p>
- <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
+ <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/usr/hdp/current/eagle/lib/log4jkafka/lib/*
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -279,10 +284,11 @@
<ul>
<li>
- <p><strong>Step 7</strong>: Check whether logs from “/var/log/hadoop/hdfs/hdfs-audit.log” are flowing into topic <code>sandbox_hdfs_audit_log</code></p>
+ <p><strong>Step 7</strong>: Check whether logs from “/var/log/hadoop/hdfs/hdfs-audit.log” are flowing into topic <code class="highlighter-rouge">sandbox_hdfs_audit_log</code></p>
- <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
</ul>
Modified: incubator/eagle/site/docs/hive-query-activity-monitoring.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/hive-query-activity-monitoring.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/hive-query-activity-monitoring.html (original)
+++ incubator/eagle/site/docs/hive-query-activity-monitoring.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/hive-query-activity-monitoring.html" id="">Policy Management</a></li>
@@ -243,12 +245,13 @@
</li>
</ul>
-<pre><code>$ su hive
+<div class="highlighter-rouge"><pre class="highlight"><code>$ su hive
$ hive
$ set hive.execution.engine=mr;
$ use xademo;
$ select a.phone_number from customer_details a, call_detail_records b where a.phone_number=b.phone_number;
</code></pre>
+</div>
<p>From UI click on alert tab and you should see alert for your attempt to read restricted column.</p>
Modified: incubator/eagle/site/docs/import-hdfs-auditLog.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/import-hdfs-auditLog.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/import-hdfs-auditLog.html (original)
+++ incubator/eagle/site/docs/import-hdfs-auditLog.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/import-hdfs-auditLog.html" id="">Policy Management</a></li>
@@ -225,9 +227,10 @@ install a <strong>namenode log4j Kafka a
<p>Here is an sample Kafka command to create topic ‘sandbox_hdfs_audit_log’</p>
- <pre><code>cd <kafka-home>
+ <div class="highlighter-rouge"><pre class="highlight"><code>cd <kafka-home>
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 2</strong>: Install Logstash-kafka plugin</p>
@@ -245,7 +248,7 @@ bin/kafka-topics.sh --create --zookeeper
<li>
<p><strong>Step 3</strong>: Create a Logstash configuration file under ${LOGSTASH_HOME}/conf. Here is a sample.</p>
- <pre><code> input {
+ <div class="highlighter-rouge"><pre class="highlight"><code> input {
file {
type => "hdp-nn-audit"
path => "/path/to/audit.log"
@@ -286,15 +289,17 @@ bin/kafka-topics.sh --create --zookeeper
}
}
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 4</strong>: Start Logstash</p>
- <pre><code>bin/logstash -f conf/sample.conf
+ <div class="highlighter-rouge"><pre class="highlight"><code>bin/logstash -f conf/sample.conf
</code></pre>
+ </div>
</li>
<li>
- <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka topic specified by <code>topic_id</code></p>
+ <p><strong>Step 5</strong>: Check whether logs are flowing into the kafka topic specified by <code class="highlighter-rouge">topic_id</code></p>
</li>
</ul>
@@ -308,14 +313,15 @@ bin/kafka-topics.sh --create --zookeeper
<li>
<p><strong>Step 1</strong>: Create a Kafka topic. Here is a example Kafka command for creating topic “sandbox_hdfs_audit_log”</p>
- <pre><code>cd <kafka-home>
+ <div class="highlighter-rouge"><pre class="highlight"><code>cd <kafka-home>
bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 2</strong>: Configure $HADOOP_CONF_DIR/log4j.properties, and add a log4j appender “KAFKA_HDFS_AUDIT” to hdfs audit logging</p>
- <pre><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
+ <div class="highlighter-rouge"><pre class="highlight"><code>log4j.appender.KAFKA_HDFS_AUDIT=org.apache.eagle.log4j.kafka.KafkaLog4jAppender
log4j.appender.KAFKA_HDFS_AUDIT.Topic=sandbox_hdfs_audit_log
log4j.appender.KAFKA_HDFS_AUDIT.BrokerList=sandbox.hortonworks.com:6667
log4j.appender.KAFKA_HDFS_AUDIT.KeyClass=org.apache.eagle.log4j.kafka.hadoop.AuditLogKeyer
@@ -325,22 +331,25 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
#log4j.appender.KAFKA_HDFS_AUDIT.BatchSize=1
#log4j.appender.KAFKA_HDFS_AUDIT.QueueSize=1
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-log4j-conf.png" alt="HDFS LOG4J Configuration" title="hdfslog4jconf" /></p>
</li>
<li>
<p><strong>Step 3</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and add the reference to KAFKA_HDFS_AUDIT to HADOOP_NAMENODE_OPTS.</p>
- <pre><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
+ <div class="highlighter-rouge"><pre class="highlight"><code>-Dhdfs.audit.logger=INFO,DRFAAUDIT,KAFKA_HDFS_AUDIT
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf.png" alt="HDFS Environment Configuration" title="hdfsenvconf" /></p>
</li>
<li>
<p><strong>Step 4</strong>: Edit $HADOOP_CONF_DIR/hadoop-env.sh, and append the following command to it.</p>
- <pre><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/*
+ <div class="highlighter-rouge"><pre class="highlight"><code>export HADOOP_CLASSPATH=${HADOOP_CLASSPATH}:/path/to/eagle/lib/log4jkafka/lib/*
</code></pre>
+ </div>
<p><img src="/images/docs/hdfs-env-conf2.png" alt="HDFS Environment Configuration" title="hdfsenvconf2" /></p>
</li>
@@ -350,8 +359,9 @@ log4j.appender.KAFKA_HDFS_AUDIT.Producer
<li>
<p><strong>Step 6</strong>: Check whether logs are flowing into Topic sandbox_hdfs_audit_log</p>
- <pre><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/kafka-broker/bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic sandbox_hdfs_audit_log
</code></pre>
+ </div>
</li>
</ul>
Modified: incubator/eagle/site/docs/index.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/index.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/index.html (original)
+++ incubator/eagle/site/docs/index.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/index.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/index.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/index.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/index.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/index.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/index.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/index.html" id="">Policy Management</a></li>
Modified: incubator/eagle/site/docs/installation.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/installation.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/installation.html (original)
+++ incubator/eagle/site/docs/installation.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/installation.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/installation.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/installation.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/installation.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/installation.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/installation.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/installation.html" id="">Policy Management</a></li>
@@ -237,7 +239,7 @@
<ul>
<li>
- <p><strong>Step 1</strong>: Clone stable version from <a href="https://github.corp.ebay.com/eagle/eagle/tree/release1.0">eagle github</a>
+ <p><strong>Step 1</strong>: Clone stable version from <a href="https://github.com/apache/incubator-eagle/releases/tag/v0.4.0-incubating">eagle github</a>
> Build project mvn clean install -DskipTests=true</p>
</li>
<li>
@@ -245,7 +247,7 @@
<ul>
<li>
- <p>Option 1: <code>scp -P 2222 eagle/eagle-assembly/target/eagle-0.1.0-bin.tar.gz root@127.0.0.1:/usr/hdp/current/</code></p>
+ <p>Option 1: <code class="highlighter-rouge">scp -P 2222 eagle/eagle-assembly/target/eagle-0.1.0-bin.tar.gz root@127.0.0.1:/usr/hdp/current/</code></p>
</li>
<li>
<p>Option 2: Create shared directory between host and Sandbox, and restart Sandbox. Then you can find the shared directory under /media in Sandbox.</p>
@@ -257,10 +259,11 @@
<li>
<p><strong>Step 3</strong>: Extract eagle tarball package</p>
- <pre><code>$ cd /usr/hdp/current
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ cd /usr/hdp/current
$ tar -zxvf eagle-0.1.0-bin.tar.gz
$ mv eagle-0.1.0 eagle
</code></pre>
+ </div>
</li>
<li>
<p><strong>Step 4</strong>: Add root as a HBase superuser via <a href="http://127.0.0.1:8080/#/main/services/HBASE/configs">Ambari</a> (Optional, a user can operate HBase by sudo su hbase, as an alternative).</p>
@@ -299,9 +302,10 @@ EagleServiceSuccess</p>
<li>
<p><strong>Step 9</strong>: Add Policies and meta data required by running below script.</p>
- <pre><code>$ /usr/hdp/current/eagle/examples/sample-sensitivity-resource-create.sh
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/eagle/examples/sample-sensitivity-resource-create.sh
$ /usr/hdp/current/eagle/examples/sample-policy-create.sh
</code></pre>
+ </div>
</li>
</ul>
Modified: incubator/eagle/site/docs/jmx-metric-monitoring.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/jmx-metric-monitoring.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/jmx-metric-monitoring.html (original)
+++ incubator/eagle/site/docs/jmx-metric-monitoring.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/jmx-metric-monitoring.html" id="">Policy Management</a></li>
@@ -215,9 +217,9 @@
<p>JMX metric for hadoop namenode url <a href="http://127.0.0.1:50070/jmx">http://127.0.0.1:50070/jmx</a> can be monitored using Apache Eagle (incubating, called Eagle in the following). Follow below steps to enable this feature in Eagle.</p>
<ol>
- <li>Install Python script (To populate JMX metric values to Kafka topic periodically.)</li>
+ <li>Install Python script (To populate JMX metric values to Kafka topic periodically)</li>
<li>Deploy “hadoopjmx” storm topology.</li>
- <li>Create new site and policy in UI</li>
+ <li>Create new site and policy in UI.</li>
<li>Validate policy alert.</li>
</ol>
@@ -233,9 +235,10 @@
<h3 id="setup"><strong>Setup</strong></h3>
<p>From Hortonworks sandbox just run below setup script to Install Pyton JMX script, Create Kafka topic, update Hbase tables and deploy “hadoopjmx” storm topology.</p>
-<pre><code>$ /usr/hdp/current/eagle/examples/hadoop-metric-sandbox-starter.sh
+<div class="highlighter-rouge"><pre class="highlight"><code>$ /usr/hdp/current/eagle/examples/hadoop-metric-sandbox-starter.sh
$ /usr/hdp/current/eagle/examples/hadoop-metric-policy-create.sh
</code></pre>
+</div>
<p><br /></p>
@@ -260,15 +263,17 @@ $ /usr/hdp/current/eagle/examples/hadoop
<li>
<p>First make sure that Kafka topic “nn_jmx_metric_sandbox” is populated with JMX metric data periodically.(To make sure that python script is running)</p>
- <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic nn_jmx_metric_sandbox
+ <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-consumer.sh --zookeeper sandbox.hortonworks.com:2181 --topic nn_jmx_metric_sandbox
</code></pre>
+ </div>
</li>
<li>
<p>Genrate Alert by producing alert triggering message into Kafka topic.</p>
- <pre><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-producer.sh --broker-list sandbox.hortonworks.com:6667 --topic nn_jmx_metric_sandbox
+ <div class="highlighter-rouge"><pre class="highlight"><code> $ /usr/hdp/2.2.4.2-2/kafka/bin/kafka-console-producer.sh --broker-list sandbox.hortonworks.com:6667 --topic nn_jmx_metric_sandbox
$ {"host": "localhost", "timestamp": 1457033916718, "metric": "hadoop.namenode.fsnamesystemstate.fsstate", "component": "namenode", "site": "sandbox", "value": 1.0}
</code></pre>
+ </div>
</li>
</ul>
Modified: incubator/eagle/site/docs/mapr-integration.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/mapr-integration.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/mapr-integration.html (original)
+++ incubator/eagle/site/docs/mapr-integration.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/mapr-integration.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/mapr-integration.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/mapr-integration.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/mapr-integration.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/mapr-integration.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/mapr-integration.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/mapr-integration.html" id="">Policy Management</a></li>
@@ -230,51 +232,58 @@
<p>First we need to enable data auditing at all three levels: cluster level, volume level and directory,file or table level.
##### Cluster level:</p>
-<pre><code> $ maprcli audit data -cluster <cluster name> -enabled true
+<div class="highlighter-rouge"><pre class="highlight"><code> $ maprcli audit data -cluster <cluster name> -enabled true
[ -maxsize <GB, defaut value is 32. When size of audit logs exceed this number, an alarm will be sent to the dashboard in the MapR Control Service > ]
[ -retention <number of Days> ]
</code></pre>
+</div>
<p>Example:</p>
-<pre><code> $ maprcli audit data -cluster mapr.cluster.com -enabled true -maxsize 30 -retention 30
+<div class="highlighter-rouge"><pre class="highlight"><code> $ maprcli audit data -cluster mapr.cluster.com -enabled true -maxsize 30 -retention 30
</code></pre>
+</div>
<h5 id="volume-level">Volume level:</h5>
-<pre><code> $ maprcli volume audit -cluster <cluster name> -enabled true
+<div class="highlighter-rouge"><pre class="highlight"><code> $ maprcli volume audit -cluster <cluster name> -enabled true
-name <volume name>
[ -coalesce <interval in minutes, the interval of time during which READ, WRITE, or GETATTR operations on one file from one client IP address are logged only once, if auditing is enabled> ]
</code></pre>
+</div>
<p>Example:</p>
-<pre><code> $ maprcli volume audit -cluster mapr.cluster.com -name mapr.tmp -enabled true
+<div class="highlighter-rouge"><pre class="highlight"><code> $ maprcli volume audit -cluster mapr.cluster.com -name mapr.tmp -enabled true
</code></pre>
+</div>
<p>To verify that auditing is enabled for a particular volume, use this command:</p>
-<pre><code> $ maprcli volume info -name <volume name> -json | grep -i 'audited\|coalesce'
+<div class="highlighter-rouge"><pre class="highlight"><code> $ maprcli volume info -name <volume name> -json | grep -i 'audited\|coalesce'
</code></pre>
+</div>
<p>and you should see something like this:</p>
-<pre><code> "audited":1,
+<div class="highlighter-rouge"><pre class="highlight"><code> "audited":1,
"coalesceInterval":60
</code></pre>
+</div>
<p>If “audited” is ‘1’ then auditing is enabled for this volume.</p>
<h5 id="directory-file-or-mapr-db-table-level">Directory, file, or MapR-DB table level:</h5>
-<pre><code> $ hadoop mfs -setaudit on <directory|file|table>
+<div class="highlighter-rouge"><pre class="highlight"><code> $ hadoop mfs -setaudit on <directory|file|table>
</code></pre>
+</div>
-<p>To check whether Auditing is Enabled for a Directory, File, or MapR-DB Table, use <code>$ hadoop mfs -ls</code>
+<p>To check whether Auditing is Enabled for a Directory, File, or MapR-DB Table, use <code class="highlighter-rouge">$ hadoop mfs -ls</code>
Example:
-Before enable the audit log on file <code>/tmp/dir</code>, try <code>$ hadoop mfs -ls /tmp/dir</code>, you should see something like this:
+Before enable the audit log on file <code class="highlighter-rouge">/tmp/dir</code>, try <code class="highlighter-rouge">$ hadoop mfs -ls /tmp/dir</code>, you should see something like this:
~~~
drwxr-xr-x Z U U - root root 0 2016-03-02 15:02 268435456 /tmp/dir
p 2050.32.131328 mapr2.da.dg:5660 mapr1.da.dg:5660
~~~
-The second <code>U</code> means auditing on this file is not enabled.
+The second <code class="highlighter-rouge">U</code> means auditing on this file is not enabled.
Enable auditing with this command:
~~~
$ hadoop mfs -setaudit on /tmp/dir
@@ -288,7 +297,7 @@ you should see something like this:
drwxr-xr-x Z U A - root root 0 2016-03-02 15:02 268435456 /tmp/dir
p 2050.32.131328 mapr2.da.dg:5660 mapr1.da.dg:5660
~~~
-We can see the previous <code>U</code> has been changed to <code>A</code> which indicates auditing on this file is enabled.</p>
+We can see the previous <code class="highlighter-rouge">U</code> has been changed to <code class="highlighter-rouge">A</code> which indicates auditing on this file is enabled.</p>
<h6 id="important">Important:</h6>
<p>When a directory has been enabled auditing, directories/files located in this dir won’t inherit auditing, but a newly created file/dir (after enabling the auditing on this dir) in this directory will.</p>
@@ -296,11 +305,11 @@ We can see the previous <code>U</code> h
<h4 id="step2-stream-log-data-into-kafka-by-using-logstash">Step2: Stream log data into Kafka by using Logstash</h4>
<p>As MapR do not have name node, instead it use CLDB service, we have to use logstash to stream log data into kafka.
- First find out the nodes that have CLDB service
-- Then find out the location of audit log files, eg: <code>/mapr/mapr.cluster.com/var/mapr/local/mapr1.da.dg/audit/</code>, file names should be in this format: <code>FSAudit.log-2016-05-04-001.json</code>
+- Then find out the location of audit log files, eg: <code class="highlighter-rouge">/mapr/mapr.cluster.com/var/mapr/local/mapr1.da.dg/audit/</code>, file names should be in this format: <code class="highlighter-rouge">FSAudit.log-2016-05-04-001.json</code>
- Created a logstash conf file and run it, following this doc<a href="https://github.com/apache/incubator-eagle/blob/dev/eagle-assembly/src/main/docs/logstash-kafka-conf.md">Logstash-kafka</a></p>
<h4 id="step3-set-up-maprfsauditlog-applicaiton-in-eagle-service">Step3: Set up maprFSAuditLog applicaiton in Eagle Service</h4>
-<p>After Eagle Service gets started, create mapFSAuditLog application using: <code>$ ./maprFSAuditLog-init.sh</code>. By default it will create maprFSAuditLog in site “sandbox”, you may need to change it to your own site.
+<p>After Eagle Service gets started, create mapFSAuditLog application using: <code class="highlighter-rouge">$ ./maprFSAuditLog-init.sh</code>. By default it will create maprFSAuditLog in site “sandbox”, you may need to change it to your own site.
After these steps you are good to go.</p>
<p>Have fun!!! :)</p>
Modified: incubator/eagle/site/docs/metadata-api.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/metadata-api.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/metadata-api.html (original)
+++ incubator/eagle/site/docs/metadata-api.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/metadata-api.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/metadata-api.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/metadata-api.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/metadata-api.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/metadata-api.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/metadata-api.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/metadata-api.html" id="">Policy Management</a></li>
Modified: incubator/eagle/site/docs/quick-start-0.3.0.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/quick-start-0.3.0.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/quick-start-0.3.0.html (original)
+++ incubator/eagle/site/docs/quick-start-0.3.0.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/quick-start-0.3.0.html" id="">Policy Management</a></li>
@@ -234,21 +236,22 @@
<li>
<p>Build manually with <a href="https://maven.apache.org/">Apache Maven</a>:</p>
- <pre><code>$ tar -zxvf apache-eagle-0.3.0-incubating-src.tar.gz
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ tar -zxvf apache-eagle-0.3.0-incubating-src.tar.gz
$ cd incubator-eagle-release-0.3.0-rc3
$ curl -O https://patch-diff.githubusercontent.com/raw/apache/incubator-eagle/pull/180.patch
$ git apply 180.patch
$ mvn clean package -DskipTests
</code></pre>
+ </div>
- <p>After building successfully, you will get tarball under <code>eagle-assembly/target/</code> named as <code>eagle-0.3.0-incubating-bin.tar.gz</code>
+ <p>After building successfully, you will get tarball under <code class="highlighter-rouge">eagle-assembly/target/</code> named as <code class="highlighter-rouge">eagle-0.3.0-incubating-bin.tar.gz</code>
<br /></p>
</li>
</ul>
<h3 id="install-eagle"><strong>Install Eagle</strong></h3>
-<pre><code> $ scp -P 2222 eagle-assembly/target/eagle-0.3.0-incubating-bin.tar.gz root@127.0.0.1:/root/
+<div class="highlighter-rouge"><pre class="highlight"><code> $ scp -P 2222 eagle-assembly/target/eagle-0.3.0-incubating-bin.tar.gz root@127.0.0.1:/root/
$ ssh root@127.0.0.1 -p 2222 (password is hadoop)
$ tar -zxvf eagle-0.3.0-incubating-bin.tar.gz
$ mv eagle-0.3.0-incubating eagle
@@ -256,6 +259,7 @@ $ mvn clean package -DskipTests
$ cd /usr/hdp/current/eagle
$ examples/eagle-sandbox-starter.sh
</code></pre>
+</div>
<p><br /></p>
Modified: incubator/eagle/site/docs/quick-start.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/quick-start.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/quick-start.html (original)
+++ incubator/eagle/site/docs/quick-start.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/quick-start.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/quick-start.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/quick-start.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/quick-start.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/quick-start.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/quick-start.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/quick-start.html" id="">Policy Management</a></li>
@@ -235,21 +237,22 @@
<li>
<p>Build manually with <a href="https://maven.apache.org/">Apache Maven</a>:</p>
- <pre><code>$ tar -zxvf apache-eagle-0.4.0-incubating-src.tar.gz
+ <div class="highlighter-rouge"><pre class="highlight"><code>$ tar -zxvf apache-eagle-0.4.0-incubating-src.tar.gz
$ cd apache-eagle-0.4.0-incubating-src
$ curl -O https://patch-diff.githubusercontent.com/raw/apache/incubator-eagle/pull/268.patch
$ git apply 268.patch
$ mvn clean package -DskipTests
</code></pre>
+ </div>
- <p>After building successfully, you will get a tarball under <code>eagle-assembly/target/</code> named <code>apache-eagle-0.4.0-incubating-bin.tar.gz</code>
+ <p>After building successfully, you will get a tarball under <code class="highlighter-rouge">eagle-assembly/target/</code> named <code class="highlighter-rouge">apache-eagle-0.4.0-incubating-bin.tar.gz</code>
<br /></p>
</li>
</ul>
<h3 id="install-eagle"><strong>Install Eagle</strong></h3>
-<pre><code> $ scp -P 2222 eagle-assembly/target/apache-eagle-0.4.0-incubating-bin.tar.gz root@127.0.0.1:/root/
+<div class="highlighter-rouge"><pre class="highlight"><code> $ scp -P 2222 eagle-assembly/target/apache-eagle-0.4.0-incubating-bin.tar.gz root@127.0.0.1:/root/
$ ssh root@127.0.0.1 -p 2222 (password is hadoop)
$ tar -zxvf apache-eagle-0.4.0-incubating-bin.tar.gz
$ mv apache-eagle-0.4.0-incubating eagle
@@ -257,20 +260,22 @@ $ mvn clean package -DskipTests
$ cd /usr/hdp/current/eagle
$ examples/eagle-sandbox-starter.sh
</code></pre>
+</div>
<p><br /></p>
<h3 id="sample-application-hive-query-activity-monitoring-in-sandbox"><strong>Sample Application: Hive query activity monitoring in sandbox</strong></h3>
-<p>After executing <code>examples/eagle-sandbox-starter.sh</code>, you have a sample application (topology) running on the storm (check with <a href="http://sandbox.hortonworks.com:8744/index.html">storm ui</a>), and a sample policy of hive activity monitoring defined.</p>
+<p>After executing <code class="highlighter-rouge">examples/eagle-sandbox-starter.sh</code>, you have a sample application (topology) running on the storm (check with <a href="http://sandbox.hortonworks.com:8744/index.html">storm ui</a>), and a sample policy of hive activity monitoring defined.</p>
<p>Next you can trigger an alert by running a hive query.</p>
-<pre><code>$ su hive
+<div class="highlighter-rouge"><pre class="highlight"><code>$ su hive
$ hive
$ set hive.execution.engine=mr;
$ use xademo;
$ select a.phone_number from customer_details a, call_detail_records b where a.phone_number=b.phone_number;
</code></pre>
+</div>
<p><br /></p>
</div><!--end of loadcontent-->
Modified: incubator/eagle/site/docs/serviceconfiguration.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/serviceconfiguration.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/serviceconfiguration.html (original)
+++ incubator/eagle/site/docs/serviceconfiguration.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/serviceconfiguration.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/serviceconfiguration.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/serviceconfiguration.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli current"><a href="/docs/serviceconfiguration.html" data-permalink="/docs/serviceconfiguration.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/serviceconfiguration.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/serviceconfiguration.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/serviceconfiguration.html" id="">Policy Management</a></li>
@@ -227,7 +229,7 @@ description of Eagle Service configurati
<li>for hbase</li>
</ul>
-<pre><code>eagle {
+<div class="highlighter-rouge"><pre class="highlight"><code>eagle {
service{
storage-type="hbase"
hbase-zookeeper-quorum="sandbox.hortonworks.com"
@@ -238,12 +240,13 @@ description of Eagle Service configurati
}
}
</code></pre>
+</div>
<ul>
<li>for mysql</li>
</ul>
-<pre><code>eagle {
+<div class="highlighter-rouge"><pre class="highlight"><code>eagle {
service {
storage-type="jdbc"
storage-adapter="mysql"
@@ -257,12 +260,13 @@ description of Eagle Service configurati
}
}
</code></pre>
+</div>
<ul>
<li>for derby</li>
</ul>
-<pre><code>eagle {
+<div class="highlighter-rouge"><pre class="highlight"><code>eagle {
service {
storage-type="jdbc"
storage-adapter="derby"
@@ -276,6 +280,7 @@ description of Eagle Service configurati
}
}
</code></pre>
+</div>
<p><br /></p>
</div><!--end of loadcontent-->
Modified: incubator/eagle/site/docs/standalone-install.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/standalone-install.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/standalone-install.html (original)
+++ incubator/eagle/site/docs/standalone-install.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/standalone-install.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/standalone-install.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/standalone-install.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/standalone-install.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/standalone-install.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/standalone-install.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/standalone-install.html" id="">Policy Management</a></li>
Modified: incubator/eagle/site/docs/terminology.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/terminology.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/terminology.html (original)
+++ incubator/eagle/site/docs/terminology.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/terminology.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/terminology.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/terminology.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/terminology.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/terminology.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/terminology.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/terminology.html" id="">Policy Management</a></li>
Added: incubator/eagle/site/docs/tutorial/classification-0.3.0.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/tutorial/classification-0.3.0.html?rev=1754706&view=auto
==============================================================================
--- incubator/eagle/site/docs/tutorial/classification-0.3.0.html (added)
+++ incubator/eagle/site/docs/tutorial/classification-0.3.0.html Mon Aug 1 06:27:07 2016
@@ -0,0 +1,345 @@
+<!DOCTYPE html>
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Eagle - Data Classification Tutorial</title>
+ <meta name="description" content="Eagle - Analyze Big Data Platforms for Security and Performance">
+
+ <meta name="keywords" content="Eagle, Hadoop, Security, Real Time">
+ <meta name="author" content="eBay Inc.">
+
+ <meta charset="utf-8">
+ <meta name="viewport" content="initial-scale=1">
+
+ <link rel="stylesheet" href="/css/animate.css">
+ <link rel="stylesheet" href="/css/bootstrap.min.css">
+
+ <link rel="stylesheet" href="/css/font-awesome.min.css">
+
+ <link rel="stylesheet" href="/css/misc.css">
+ <link rel="stylesheet" href="/css/style.css">
+ <link rel="stylesheet" href="/css/styles.css">
+ <link rel="stylesheet" href="/css/main.css">
+ <link rel="alternate" type="application/rss+xml" title="Eagle" href="http://goeagle.io/feed.xml" />
+ <link rel="shortcut icon" href="/images/favicon.png">
+
+ <!-- Baidu Analytics Tracking-->
+ <script>
+ var _hmt = _hmt || [];
+ (function() {
+ var hm = document.createElement("script");
+ hm.src = "//hm.baidu.com/hm.js?fedc55df2ea52777a679192e8f849ece";
+ var s = document.getElementsByTagName("script")[0];
+ s.parentNode.insertBefore(hm, s);
+ })();
+ </script>
+
+ <!-- Google Analytics Tracking -->
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ ga('create', 'UA-68929805-1', 'auto');
+ ga('send', 'pageview');
+ </script>
+</head>
+<body>
+<!-- header start -->
+<div id="home_page">
+ <div class="topbar">
+ <div class="container">
+ <div class="row" >
+ <nav class="navbar navbar-default">
+ <div class="container-fluid">
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1"> <span class="sr-only">Toggle navigation</span> <span class="icon-bar"></span> <span class="icon-bar"></span> <span class="icon-bar"></span> </button>
+ <a class="navbar-brand" href="/"><img src="/images/logo2.png" height="44px" style="margin-top:-7px"></a> </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <!-- <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav navbar-right" id="top-menu">
+ <li><a class="menu" href="/#home_page">HOME</a></li>
+ <li><a class="menu" href="/docs/">DOCS</a></li>
+ <li><a class="menu" href="/#about_page">ABOUT</a></li>
+ <li><a class="menu" href="/#diagram_page">ARCHITECTURE</a></li>
+ <li><a class="menu" href="/#modules_page">MODULES</a></li>
+ <li><a class="menu" href="/#usecase_page">USE CASES</a></li>
+ <li>
+ </li>
+ </ul> -->
+ </div>
+ </div>
+ <!-- /.container-fluid -->
+ </nav>
+ </div>
+ </div>
+ </div>
+ <div class="headerimage">
+ <div class="flexslider">
+ <ul class="slides">
+ <li><img src="/images/slider/4.jpg" alt="Slide 1"></li>
+ </ul>
+ </div>
+ </div>
+ <div class="particles" style="height:40%"> </div><!---particles-->
+ <div class="slider-caption" style="top:80px;">
+ <div class="homewrapper">
+ <div class="hometitle">
+ <a href="/">
+ <img src="/images/feather.png" height="80px">
+ </a>
+ </div>
+ <div class="hometext">
+ <h2>Analyze Big Data Platforms For Security and Performance</h2>
+ <div class="social-buttons">
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
+ <a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
+ <a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
+ <a href="#"><i class="fa fa-weixin"></i></a> -->
+ <!-- <a href="https://www.weibo.com/ApacheEagle/"><i class="fa fa-weibo"></i></a> -->
+ </div>
+ </div>
+ </div>
+ </div>
+</div>
+<!-- header end -->
+<div class="container-fluid page-content">
+ <!--
+ <a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
+
+ <div class="row">
+ <div class="col-md-10 col-md-offset-1">
+ <!-- sidebar -->
+ <div class="col-xs-6 col-sm-3" id="sidebar" role="navigation">
+ <ul class="nav" id="adminnav">
+
+ <li class="heading">Getting Started</li>
+
+ <li class="sidenavli "><a href="/docs/index.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Introduction</a></li>
+
+ <li class="sidenavli "><a href="/docs/usecases.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Use Cases</a></li>
+
+ <li class="sidenavli "><a href="/docs/terminology.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Terminology</a></li>
+
+ <li class="sidenavli "><a href="/docs/ecosystem.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Ecosystem</a></li>
+
+ <li class="sidenavli "><a href="/docs/community.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Community</a></li>
+
+ <li class="sidenavli "><a href="/docs/FAQ.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">FAQ</a></li>
+
+ <li class="divider"></li>
+
+ <li class="heading">Download</li>
+
+ <li class="sidenavli "><a href="/docs/download-0.4.0.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Latest version</a></li>
+
+ <li class="sidenavli "><a href="/docs/download.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Archived</a></li>
+
+ <li class="divider"></li>
+
+ <li class="heading">Installation</li>
+
+ <li class="sidenavli "><a href="/docs/quick-start.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Get Started with Sandbox</a></li>
+
+ <li class="sidenavli "><a href="/docs/deployment-in-docker.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Get Started with Docker</a></li>
+
+ <li class="sidenavli "><a href="/docs/deployment-env.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Setup Environment</a></li>
+
+ <li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Setup Eagle in Production</a></li>
+
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Eagle Application Configuration</a></li>
+
+ <li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Eagle Service Configuration</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/ldap.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Eagle LDAP Authentication</a></li>
+
+ <li class="divider"></li>
+
+ <li class="heading">Tutorial</li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Site Management</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Policy Management</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/policy-capabilities.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Policy Engine Capabilities</a></li>
+
+ <li class="sidenavli "><a href="/docs/hdfs-data-activity-monitoring.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">HDFS Data Activity Monitoring</a></li>
+
+ <li class="sidenavli "><a href="/docs/hive-query-activity-monitoring.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">HIVE Query Activity Monitoring</a></li>
+
+ <li class="sidenavli "><a href="/docs/hbase-data-activity-monitoring.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">HBASE Data Activity Monitoring</a></li>
+
+ <li class="sidenavli "><a href="/docs/mapr-integration.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">MapR FS Data Activity Monitoring</a></li>
+
+ <li class="sidenavli "><a href="/docs/jmx-metric-monitoring.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Hadoop JMX Metrics Monitoring</a></li>
+
+ <li class="sidenavli "><a href="/docs/import-hdfs-auditLog.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Stream HDFS audit logs into Kafka</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/userprofile.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">User Profile Feature</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/classification.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Data Classification Feature</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/topologymanagement.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Topology Management Feature</a></li>
+
+ <li class="sidenavli "><a href="/docs/tutorial/notificationplugin.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Alert Notification Plugin</a></li>
+
+ <li class="sidenavli "><a href="/docs/metadata-api.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Metadata RESTful API</a></li>
+
+ <li class="divider"></li>
+
+ <li class="heading">Development Guide</li>
+
+ <li class="sidenavli "><a href="/docs/development-quick-guide.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Development Quick Guide</a></li>
+
+ <li class="sidenavli "><a href="/docs/development-in-macosx.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Development in Mac OSX</a></li>
+
+ <li class="sidenavli "><a href="/docs/development-in-intellij.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">Development in Intellij</a></li>
+
+ <li class="divider"></li>
+
+ <li class="heading">Advanced</li>
+
+ <li class="sidenavli "><a href="/docs/user-profile-ml.html" data-permalink="/docs/tutorial/classification-0.3.0.html" id="">User Profile Machine Learning</a></li>
+
+ <li class="divider"></li>
+
+ <li class="sidenavli">
+ <a href="mailto:dev@eagle.incubator.apache.org" target="_blank">Need Help?</a>
+ </li>
+ </ul>
+ </div>
+ <div class="col-xs-6 col-sm-9 page-main-content" style="margin-left: -15px" id="loadcontent">
+ <h1 class="page-header" style="margin-top: 0px">Data Classification Tutorial</h1>
+ <p>Apache Eagle (incubating) data classification feature provides the ability to classify data with different levels of sensitivity.
+Currently this feature is available ONLY for applications monitoring HDFS, Hive and HBase. For example, HdfsAuditLog, HiveQueryLog and HBaseSecurityLog.</p>
+
+<p>The main content of this page are</p>
+
+<ul>
+ <li>Connection Configuration</li>
+ <li>Data Classification</li>
+</ul>
+
+<h3 id="connection-configuration">Connection Configuration</h3>
+
+<p>To monitor a remote cluster, we first make sure the connection to the cluster is configured. For more details, please refer to <a href="/docs/tutorial/site-0.3.0.html">Site Management</a></p>
+
+<h3 id="data-classification">Data Classification</h3>
+
+<p>After the configuration is The first part is about how to add/remove sensitivity to files/directories; the second part shows how to monitor these sensitive data. In the following, we take HdfsAuditLog as an example.</p>
+
+<h4 id="part-1-sensitivity-edit"><strong>Part 1: Sensitivity Edit</strong></h4>
+
+<ul>
+ <li>
+ <p>add the sensitive mark to files/directories.</p>
+
+ <ul>
+ <li>
+ <p><strong>Basic</strong>: Label sensitivity files directly (<strong>recommended</strong>)</p>
+
+ <p><img src="/images/docs/hdfs-mark1.png" alt="HDFS classification" />
+ <img src="/images/docs/hdfs-mark2.png" alt="HDFS classification" />
+ <img src="/images/docs/hdfs-mark3.png" alt="HDFS classification" /></p>
+ </li>
+ <li>
+ <p><strong>Advanced</strong>: Import json file/content</p>
+
+ <p><img src="/images/docs/hdfs-import1.png" alt="HDFS classification" />
+ <img src="/images/docs/hdfs-import2.png" alt="HDFS classification" />
+ <img src="/images/docs/hdfs-import3.png" alt="HDFS classification" /></p>
+ </li>
+ </ul>
+ </li>
+ <li>
+ <p>remove sensitive mark on files/directories</p>
+
+ <ul>
+ <li>
+ <p><strong>Basic</strong>: remove label directly</p>
+
+ <p><img src="/images/docs/hdfs-delete1.png" alt="HDFS classification" />
+ <img src="/images/docs/hdfs-delete2.png" alt="HDFS classification" /></p>
+ </li>
+ <li>
+ <p><strong>Advanced</strong>: delete lin batch</p>
+
+ <p><img src="/images/docs/hdfs-remove.png" alt="HDFS classification" /></p>
+ </li>
+ </ul>
+ </li>
+</ul>
+
+<h4 id="part-2-sensitivity-usage-in-policy-definition"><strong>Part 2: Sensitivity Usage in Policy Definition</strong></h4>
+
+<p>You can mark a particular folder/file as “PRIVATE”. Once you have this information you can create policies using this label.</p>
+
+<blockquote>
+ <p>For example: the following policy monitors all the operations to resources with sensitivity type “PRIVATE”.</p>
+</blockquote>
+
+<p><img src="/images/docs/sensitivity-policy.png" alt="sensitivity type policy" /></p>
+
+
+ </div><!--end of loadcontent-->
+ </div>
+ <!--end of centered content-->
+ </div>
+</div>
+<!--end of container-->
+
+<!-- footer start -->
+<div class="footerwrapper">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12"><div style="margin-left:auto; margin-right:auto; text-align:center;font-size: 12px">
+<div>
+Apache Eagle is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+</div>
+<div>
+<a href="http://www.apache.org">
+<img id="asf-logo" alt="Apache Software Foundation" src="/images/apache-logo-small.gif">
+</a>
+<a href="http://incubator.apache.org">
+<img id="incubator-logo" alt="Apache Incubator" src="/images/apache-incubator-logo-small.png">
+</a>
+</div>
+<div>
+Copyright © 2015 <a href="http://www.apache.org">The Apache Software Foundation</a>, Licensed under the <a href="http://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>.
+</div>
+<div>
+Apache Eagle, Eagle, Apache, the Apache feather logo, and the Apache Incubator project logo are trademarks of The Apache Software Foundation.
+</div>
+ </div></div>
+ </div>
+ </div>
+</div>
+<!-- footer end -->
+
+<!-- JavaScripts -->
+<script src="/js/jquery-1.11.1.min.js"></script>
+<script src="/js/jquery.singlePageNav.js"></script>
+<script src="/js/jquery.flexslider.js"></script>
+<script src="/js/modernizr.min.js"></script>
+<script src="/js/svg.js"></script>
+<script>
+ /************** FlexSlider *********************/
+ $('.flexslider').flexslider({
+ animation: "fade",
+ directionNav: false
+ });
+</script>
+
+<script>
+ /************** FlexSlider *********************/
+ $('.flexslider').flexslider({
+ animation: "fade",
+ directionNav: false
+ });
+</script>
+</body>
+</html>
Modified: incubator/eagle/site/docs/tutorial/classification.html
URL: http://svn.apache.org/viewvc/incubator/eagle/site/docs/tutorial/classification.html?rev=1754706&r1=1754705&r2=1754706&view=diff
==============================================================================
--- incubator/eagle/site/docs/tutorial/classification.html (original)
+++ incubator/eagle/site/docs/tutorial/classification.html Mon Aug 1 06:27:07 2016
@@ -95,7 +95,7 @@
<div class="hometext">
<h2>Analyze Big Data Platforms For Security and Performance</h2>
<div class="social-buttons">
- <!-- <a href="https://github.com/ebay/eagle"><i class="fa fa-github"></i></a>
+ <!-- <a href="https://github.com/apache/incubator-eagle"><i class="fa fa-github"></i></a>
<a href="http://twitter.com/TheApacheEagle"><i class="fa fa-twitter"></i></a>
<a href="https://www.facebook.com/TheApacheEagle/"><i class="fa fa-facebook"></i></a>
<a href="#"><i class="fa fa-weixin"></i></a> -->
@@ -107,7 +107,9 @@
</div>
<!-- header end -->
<div class="container-fluid page-content">
+ <!--
<a href="https://github.com/apache/incubator-eagle" target="_blank"><img style="z-index:10000;position: fixed; top: 0; right: 0; border: 0;" src="https://camo.githubusercontent.com/365986a132ccd6a44c23a9169022c0b5c890c387/68747470733a2f2f73332e616d617a6f6e6177732e636f6d2f6769746875622f726962626f6e732f666f726b6d655f72696768745f7265645f6161303030302e706e67" alt="Fork eagle on GitHub" data-canonical-src="https://s3.amazonaws.com/github/ribbons/forkme_right_red_aa0000.png"></a>
+ -->
<div class="row">
<div class="col-md-10 col-md-offset-1">
@@ -149,7 +151,7 @@
<li class="sidenavli "><a href="/docs/deployment-in-production.html" data-permalink="/docs/tutorial/classification.html" id="">Setup Eagle in Production</a></li>
- <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/tutorial/classification.html" id="">Eagle Topology Configuration</a></li>
+ <li class="sidenavli "><a href="/docs/configuration.html" data-permalink="/docs/tutorial/classification.html" id="">Eagle Application Configuration</a></li>
<li class="sidenavli "><a href="/docs/serviceconfiguration.html" data-permalink="/docs/tutorial/classification.html" id="">Eagle Service Configuration</a></li>
@@ -159,7 +161,7 @@
<li class="heading">Tutorial</li>
- <li class="sidenavli "><a href="/docs/tutorial/setup.html" data-permalink="/docs/tutorial/classification.html" id="">Site Management</a></li>
+ <li class="sidenavli "><a href="/docs/tutorial/site.html" data-permalink="/docs/tutorial/classification.html" id="">Site Management</a></li>
<li class="sidenavli "><a href="/docs/tutorial/policy.html" data-permalink="/docs/tutorial/classification.html" id="">Policy Management</a></li>
@@ -212,15 +214,117 @@
</div>
<div class="col-xs-6 col-sm-9 page-main-content" style="margin-left: -15px" id="loadcontent">
<h1 class="page-header" style="margin-top: 0px">Data Classification Tutorial</h1>
- <p>Apache Eagle (incubating) Data classification provides the ability to classify HDFS and Hive data with different levels of sensitivity.
-For both HDFS and Hive, a user can browse the resources and add/remove the sensitivity information.</p>
+ <p>Apache Eagle (incubating) data classification feature provides the ability to classify data with different levels of sensitivity.
+Currently this feature is available ONLY for applications monitoring HDFS, Hive and HBase. For example, HdfsAuditLog, HiveQueryLog and HBaseSecurityLog.</p>
-<p>The document has two parts. The first part is about how to add/remove sensitivity to files/directories; the second part shows the application
-of sensitivity in policy definition. Showing HDFS as an example.</p>
+<p>The main content of this page are</p>
-<blockquote>
- <p><strong>WARNING</strong>: sensitivity is classified by sites. Please select the right site first when there are multiple ones.</p>
-</blockquote>
+<ul>
+ <li>Cluster Connection</li>
+ <li>Data Classification</li>
+</ul>
+
+<h3 id="cluster-connection">Cluster Connection</h3>
+
+<p>Here we give example configurations for HDFS, HBASE, and Hive. Suppose the cluster to monitor is Hortonwork sandbox. This configuration locates at the admin management page.</p>
+
+<ul>
+ <li>
+ <p>HDFS</p>
+
+ <p><img src="/images/docs/hdfs-setup.png" alt="hdfs setup" /></p>
+
+ <ul>
+ <li>
+ <p>Base case</p>
+
+ <p>You may configure the default path for Hadoop clients to connect remote hdfs namenode.</p>
+
+ <div class="highlighter-rouge"><pre class="highlight"><code> classification.fs.defaultFS=hdfs://sandbox.hortonworks.com:8020
+</code></pre>
+ </div>
+ </li>
+ <li>
+ <p>HA case</p>
+
+ <p>Basically, you point your fs.defaultFS at your nameservice and let the client know how its configured (the backing namenodes) and how to fail over between them under the HA mode</p>
+
+ <div class="highlighter-rouge"><pre class="highlight"><code> classification.fs.defaultFS=hdfs://nameservice1
+ classification.dfs.nameservices=nameservice1
+ classification.dfs.ha.namenodes.nameservice1=namenode1,namenode2
+ classification.dfs.namenode.rpc-address.nameservice1.namenode1=hadoopnamenode01:8020
+ classification.dfs.namenode.rpc-address.nameservice1.namenode2=hadoopnamenode02:8020
+ classification.dfs.client.failover.proxy.provider.nameservice1=org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider
+</code></pre>
+ </div>
+ </li>
+ <li>
+ <p>Kerberos-secured cluster</p>
+
+ <p>For Kerberos-secured cluster, you need to get a keytab file and the principal from your admin, and configure “eagle.keytab.file” and “eagle.kerberos.principal” to authenticate its access.</p>
+
+ <div class="highlighter-rouge"><pre class="highlight"><code> classification.eagle.keytab.file=/EAGLE-HOME/.keytab/eagle.keytab
+ classification.eagle.kerberos.principal=eagle@SOMEWHERE.COM
+</code></pre>
+ </div>
+
+ <p>If there is an exception about “invalid server principal name”, you may need to check the DNS resolver, or the data transfer , such as “dfs.encrypt.data.transfer”, “dfs.encrypt.data.transfer.algorithm”, “dfs.trustedchannel.resolver.class”, “dfs.datatransfer.client.encrypt”.</p>
+ </li>
+ </ul>
+ </li>
+ <li>Hive
+ <ul>
+ <li>
+ <p>Basic</p>
+
+ <div class="highlighter-rouge"><pre class="highlight"><code> classification.accessType=metastoredb_jdbc
+ classification.password=hive
+ classification.user=hive
+ classification.jdbcDriverClassName=com.mysql.jdbc.Driver
+ classification.jdbcUrl=jdbc:mysql://sandbox.hortonworks.com/hive?createDatabaseIfNotExist=true
+</code></pre>
+ </div>
+ </li>
+ </ul>
+ </li>
+ <li>
+ <p>HBase</p>
+
+ <ul>
+ <li>
+ <p>Basic case</p>
+
+ <p>You need to sett “hbase.zookeeper.quorum”:”localhost” property and “hbase.zookeeper.property.clientPort” property.</p>
+
+ <div class="highlighter-rouge"><pre class="highlight"><code> classification.hbase.zookeeper.property.clientPort=2181
+ classification.hbase.zookeeper.quorum=localhost
+</code></pre>
+ </div>
+ </li>
+ <li>
+ <p>Kerberos-secured cluster</p>
+
+ <p>According to your environment, you can add or remove some of the following properties. Here is the reference.</p>
+
+ <div class="highlighter-rouge"><pre class="highlight"><code> classification.hbase.zookeeper.property.clientPort=2181
+ classification.hbase.zookeeper.quorum=localhost
+ classification.hbase.security.authentication=kerberos
+ classification.hbase.master.kerberos.principal=hadoop/_HOST@EXAMPLE.COM
+ classification.zookeeper.znode.parent=/hbase
+ classification.eagle.keytab.file=/EAGLE-HOME/.keytab/eagle.keytab
+ classification.eagle.kerberos.principal=eagle@EXAMPLE.COM
+</code></pre>
+ </div>
+ </li>
+ </ul>
+ </li>
+</ul>
+
+<p>Any questions on the Kerberos configuration in Eagle, please first check <a href="/docs/FAQ.html">FAQ</a></p>
+
+<h3 id="data-classification">Data Classification</h3>
+
+<p>After the configuration is updated, we can go back to the classification page on Eagle UI. Here we take HdfsAuditLog as an example to explain how to classify data and how to monitor sensitive data in Eagle.</p>
<h4 id="part-1-sensitivity-edit"><strong>Part 1: Sensitivity Edit</strong></h4>
@@ -264,7 +368,7 @@ of sensitivity in policy definition. Sho
</li>
</ul>
-<h4 id="part-2-sensitivity-usage-in-policy-definition"><strong>Part 2: Sensitivity Usage in Policy Definition</strong></h4>
+<h4 id="part-2-monitor-sensitive-data">**Part 2: Monitor sensitive data</h4>
<p>You can mark a particular folder/file as “PRIVATE”. Once you have this information you can create policies using this label.</p>