You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spot.apache.org by le...@apache.org on 2019/09/11 01:39:29 UTC
[incubator-spot] branch asf-site updated (92b0192 -> dacbb29)
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a change to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git.
from 92b0192 Remove Kerberos support on documentation
new 669cc00 Removed Slack Website References
new ffdf3d6 Confluence References
new 33ab5bd Ignoring Node_Modules folder for the site.
new 743deaa Bug Fix: Duplicate Link to Confluence Page.
new da375f8 Added substitute function and fixed GetRoot to not be hardcoded.
new bdfc505 Updated copyright to 2018
new eda98a4 replaced 2018 copyright with 2019
new 0081dcc fixed user mailing list address
new dacbb29 Merge pull request #147 from schonz/asf-site
The 45 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 1 +
2016/03/index.html | 5 +-
2016/08/index.html | 5 +-
2016/09/index.html | 5 +-
2016/10/index.html | 5 +-
2017/03/index.html | 5 +-
README.md | 126 +++++
_Tools/page-massedit.py | 171 +++++++
apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-3-most-asked-questions/index.html | 5 +-
.../index.html | 5 +-
.../index.html | 5 +-
.../index.html | 5 +-
blog/index.html | 5 +-
.../jupyter-notebooks-for-data-analysis/index.html | 5 +-
.../index.html | 5 +-
category/cybersecurity/index.html | 5 +-
category/data-science/index.html | 5 +-
category/ipython-notebooks/index.html | 5 +-
category/security-analytics/index.html | 5 +-
category/threat-analysis-tools/index.html | 5 +-
category/uncategorized/index.html | 5 +-
community/committers/index.html | 5 +-
community/contribute/index.html | 5 +-
community/index.html | 373 ++++++++------
contribute/index.html | 4 +-
doc/index.html | 3 +-
download/index.html | 5 +-
get-started/architecture/index.html | 5 +-
get-started/demo/index.html | 5 +-
get-started/environment/index.html | 5 +-
get-started/index.html | 5 +-
get-started/supporting-apache/index.html | 5 +-
.../index.html | 2 +-
.../index.html | 2 +-
index.html | 6 +-
jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
project-components/ingestion/index.html | 9 +-
project-components/machine-learning/index.html | 9 +-
project-components/open-data-models/index.html | 7 +-
.../suspicious-connects-analysis/index.html | 7 +-
project-components/visualization/index.html | 5 +-
.../index.html | 554 ++++++++++-----------
tag/github/index.html | 5 +-
tag/open-network-insight/index.html | 5 +-
tag/open-source/index.html | 5 +-
49 files changed, 870 insertions(+), 564 deletions(-)
create mode 100644 .gitignore
create mode 100644 README.md
create mode 100644 _Tools/page-massedit.py
[incubator-spot] 17/45: Incorporating new HTML and picture files to
Spot website
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 67c0416b4b8b5d055e4f1c27db286cd916eddf98
Author: Cesar <ce...@apache.org>
AuthorDate: Tue Jan 17 18:49:17 2017 -0600
Incorporating new HTML and picture files to Spot website
---
.DS_Store | Bin 0 -> 10244 bytes
2016/03/index.php | 60 +
2016/08/index.php | 88 ++
2016/09/index.php | 57 +
2016/10/index.php | 60 +
2016/index.php | 0
.../feed/index.html | 18 +
blog/apache-spot-3-most-asked-questions/index.php | 94 ++
.../feed/index.html | 18 +
.../index.php | 98 ++
.../feed/index.html | 18 +
.../index.php | 80 ++
blog/index.php | 153 +++
.../feed/index.html | 18 +
blog/jupyter-notebooks-for-data-analysis/index.php | 128 ++
.../feed/index.html | 18 +
.../index.php | 69 +
category/cybersecurity/index.php | 59 +
category/data-science/index.php | 59 +
category/index.php | 0
category/ipython-notebooks/index.php | 56 +
category/security-analytics/index.php | 58 +
category/threat-analysis-tools/index.php | 58 +
category/uncategorized/index.php | 85 ++
contribute/index.php | 86 ++
doc/css/meanmenu.css | 170 +++
doc/css/style.css | 547 ++++++++
doc/fonts/icomoon.eot | Bin 0 -> 1932 bytes
doc/fonts/icomoon.svg | 14 +
doc/fonts/icomoon.ttf | Bin 0 -> 1768 bytes
doc/fonts/icomoon.woff | Bin 0 -> 1844 bytes
doc/fonts/menu.eot | Bin 0 -> 1284 bytes
doc/fonts/menu.svg | 13 +
doc/fonts/menu.ttf | Bin 0 -> 1132 bytes
doc/fonts/menu.woff | Bin 0 -> 1208 bytes
doc/images/1.1_dns_sb01.jpg | Bin 0 -> 110277 bytes
doc/images/1.1_dns_sb02.jpg | Bin 0 -> 112282 bytes
doc/images/1.1_dns_sc01.jpg | Bin 0 -> 429125 bytes
doc/images/1.1_dns_ti01.jpg | Bin 0 -> 58380 bytes
doc/images/1.1_dns_ti02.png | Bin 0 -> 21081 bytes
doc/images/1.1_dns_ti03.jpg | Bin 0 -> 76401 bytes
doc/images/1.1_dns_ti04.jpg | Bin 0 -> 82380 bytes
doc/images/1.1_dns_ti05.jpg | Bin 0 -> 16338 bytes
doc/images/1.1_proxy_sb01.jpg | Bin 0 -> 69827 bytes
doc/images/1.1_proxy_sb02.jpg | Bin 0 -> 112775 bytes
doc/images/1.1_proxy_sb03.jpg | Bin 0 -> 49804 bytes
doc/images/1.1_proxy_sb04.jpg | Bin 0 -> 74732 bytes
doc/images/1.1_proxy_sb05.jpg | Bin 0 -> 36627 bytes
doc/images/1.1_proxy_sb06.jpg | Bin 0 -> 143049 bytes
doc/images/1.1_proxy_sc01.jpg | Bin 0 -> 295489 bytes
doc/images/1.1_proxy_sc02.jpg | Bin 0 -> 36772 bytes
doc/images/1.1_proxy_sc03.jpg | Bin 0 -> 40111 bytes
doc/images/1.1_proxy_sc04.jpg | Bin 0 -> 113443 bytes
doc/images/1.1_proxy_sc05.jpg | Bin 0 -> 50650 bytes
doc/images/1.1_proxy_sc06.jpg | Bin 0 -> 62302 bytes
doc/images/1.1_proxy_sc07.jpg | Bin 0 -> 41372 bytes
doc/images/1.1_proxy_sc08.jpg | Bin 0 -> 76114 bytes
doc/images/1.1_proxy_sc09.jpg | Bin 0 -> 65889 bytes
doc/images/1.1_proxy_sc10.jpg | Bin 0 -> 72009 bytes
doc/images/1.1_proxy_ti01.jpg | Bin 0 -> 57177 bytes
doc/images/1.1_proxy_ti02.jpg | Bin 0 -> 73257 bytes
doc/images/1.1_proxy_ti03.jpg | Bin 0 -> 159249 bytes
doc/images/1.1_proxy_ti04.jpg | Bin 0 -> 12598 bytes
doc/images/1.1_sc10.jpg | Bin 0 -> 100932 bytes
doc/images/1.1_sc2.jpg | Bin 0 -> 163175 bytes
doc/images/1.1_sc3.jpg | Bin 0 -> 413811 bytes
doc/images/1.1_sc4.jpg | Bin 0 -> 117613 bytes
doc/images/1.1_sc5.jpg | Bin 0 -> 117542 bytes
doc/images/1.1_sc6.jpg | Bin 0 -> 68949 bytes
doc/images/1.1_sc7.jpg | Bin 0 -> 72326 bytes
doc/images/1.1_sc8.jpg | Bin 0 -> 73367 bytes
doc/images/1.1_sc9.jpg | Bin 0 -> 171138 bytes
doc/images/1.1_technical_overviewv02.jpg | Bin 0 -> 114063 bytes
doc/images/1.1_ti01.jpg | Bin 0 -> 227065 bytes
doc/images/1.1_ti02.jpg | Bin 0 -> 79562 bytes
doc/images/1.1_ti03.jpg | Bin 0 -> 35558 bytes
doc/images/1.1sc1.jpg | Bin 0 -> 229276 bytes
doc/images/add-to-slack.png | Bin 0 -> 2506 bytes
doc/images/apache-incubator.png | Bin 0 -> 7213 bytes
doc/images/apple-touch-icon.png | Bin 0 -> 11173 bytes
doc/images/cd-top-arrow.svg | 7 +
doc/images/close.png | Bin 0 -> 1382 bytes
doc/images/dns_sb_tit1.JPG | Bin 0 -> 39484 bytes
doc/images/flow_sb_1.JPG | Bin 0 -> 106540 bytes
doc/images/flow_sb_2.JPG | Bin 0 -> 26249 bytes
doc/images/flow_sb_3.JPG | Bin 0 -> 32924 bytes
doc/images/flow_sb_4.JPG | Bin 0 -> 20536 bytes
doc/images/flow_sb_4b.JPG | Bin 0 -> 18885 bytes
doc/images/flow_sb_5.JPG | Bin 0 -> 28232 bytes
doc/images/flow_sb_6.JPG | Bin 0 -> 21984 bytes
doc/images/hybrid_hadoop.bmp | Bin 0 -> 2448462 bytes
doc/images/is1.png | Bin 0 -> 39172 bytes
doc/images/is2.png | Bin 0 -> 49574 bytes
doc/images/logo.png | Bin 0 -> 8007 bytes
doc/images/masthead-bg.jpg | Bin 0 -> 431055 bytes
doc/images/open.png | Bin 0 -> 1381 bytes
doc/images/pure_hadoop.bmp | Bin 0 -> 4963738 bytes
doc/images/sb_tit1.JPG | Bin 0 -> 58807 bytes
doc/images/win8-tile-icon.png | Bin 0 -> 14766 bytes
doc/index.html | 1444 ++++++++++++++++++++
doc/js/classie.js | 70 +
doc/js/jquery-migrate.min.js | 2 +
doc/js/jquery.meanmenu.js | 285 ++++
doc/js/libs/modernizr.custom.min.js | 4 +
doc/js/scripts.js | 176 +++
doc/spot.css | 81 ++
favicon.png | Bin 0 -> 2787 bytes
includes/config.php | 7 +
includes/download-sidebar.php | 14 +
includes/footer.php | 22 +
includes/header.php | 116 ++
includes/prefooter.php | 22 +
includes/sidebar.php | 41 +
index.php | 283 ++++
library/css/meanmenu.css | 170 +++
library/css/style.css | 1189 ++++++++++++++++
library/fonts/icomoon.eot | Bin 0 -> 1932 bytes
library/fonts/icomoon.svg | 14 +
library/fonts/icomoon.ttf | Bin 0 -> 1768 bytes
library/fonts/icomoon.woff | Bin 0 -> 1844 bytes
library/images/FloCon2015.png | Bin 0 -> 43681 bytes
.../images/ONI_Architecture-Diagram_1300_v4.png | Bin 0 -> 449035 bytes
library/images/SPOT_Collabration-Icon_v2.png | Bin 0 -> 3852 bytes
library/images/SPOT_OpenDataModel-Icon_v1.png | Bin 0 -> 3906 bytes
library/images/add-to-slack.png | Bin 0 -> 2506 bytes
library/images/advantages-1.png | Bin 0 -> 37207 bytes
library/images/and.png | Bin 0 -> 1699 bytes
library/images/apache-incubator.png | Bin 0 -> 7213 bytes
library/images/apple-touch-icon.png | Bin 0 -> 11173 bytes
library/images/bullet.png | Bin 0 -> 974 bytes
library/images/cd-top-arrow.svg | 7 +
library/images/community/centrify.png | Bin 0 -> 8050 bytes
library/images/community/cloudera.png | Bin 0 -> 6093 bytes
library/images/community/cloudwick.png | Bin 0 -> 4173 bytes
library/images/community/cybraics.png | Bin 0 -> 5196 bytes
library/images/community/ebay.png | Bin 0 -> 6778 bytes
library/images/community/endgame.png | Bin 0 -> 8110 bytes
library/images/community/intel.png | Bin 0 -> 5938 bytes
library/images/community/jask.png | Bin 0 -> 3866 bytes
library/images/community/rich-it.png | Bin 0 -> 5510 bytes
library/images/community/semantix.png | Bin 0 -> 6987 bytes
library/images/community/webroot.png | Bin 0 -> 6305 bytes
library/images/connects.png | Bin 0 -> 3696 bytes
library/images/details.png | Bin 0 -> 92267 bytes
library/images/how-it-works.png | Bin 0 -> 45779 bytes
library/images/iPython-1.png | Bin 0 -> 12682 bytes
library/images/individual-push.png | Bin 0 -> 142301 bytes
library/images/ingest-summary.png | Bin 0 -> 56195 bytes
library/images/ingestion.png | Bin 0 -> 178178 bytes
library/images/key_features_bg.jpg | Bin 0 -> 23292 bytes
library/images/logo.png | Bin 0 -> 8007 bytes
library/images/machine-learning.png | Bin 0 -> 179821 bytes
library/images/magnify-icon.png | Bin 0 -> 3770 bytes
library/images/masthead-bg.jpg | Bin 0 -> 431055 bytes
library/images/masthead-bg.png | Bin 0 -> 70435 bytes
library/images/network.png | Bin 0 -> 62056 bytes
library/images/not needed/FloCon2015-300x225.png | Bin 0 -> 40316 bytes
library/images/not needed/FloCon2015-768x576.png | Bin 0 -> 111556 bytes
.../ONI_Architecture-Diagram_1300_v4-1024x532.png | Bin 0 -> 309743 bytes
.../ONI_Architecture-Diagram_1300_v4-300x156.png | Bin 0 -> 36669 bytes
.../ONI_Architecture-Diagram_1300_v4-768x399.png | Bin 0 -> 185948 bytes
.../ONI_Architecture-Diagram_1300_v4_old.png | Bin 0 -> 431626 bytes
library/images/not needed/advantages-1-300x136.png | Bin 0 -> 16738 bytes
library/images/not needed/advantages-1-768x347.png | Bin 0 -> 54522 bytes
library/images/not needed/iPython-1-300x89.png | Bin 0 -> 13403 bytes
library/images/notebook.png | Bin 0 -> 54507 bytes
library/images/odm.png | Bin 0 -> 36674 bytes
library/images/quote-person.png | Bin 0 -> 1881 bytes
library/images/quotes.png | Bin 0 -> 886 bytes
library/images/search.png | Bin 0 -> 391 bytes
library/images/spot470.png | Bin 0 -> 16211 bytes
library/images/storyboard-icon.png | Bin 0 -> 3317 bytes
library/images/suspicious.png | Bin 0 -> 80577 bytes
library/images/threat-icon.png | Bin 0 -> 3542 bytes
library/images/topic-branching.png | Bin 0 -> 132983 bytes
library/images/win8-tile-icon.png | Bin 0 -> 14766 bytes
library/js/jquery-migrate.min.js | 2 +
library/js/jquery.js | 6 +
library/js/jquery.meanmenu.js | 285 ++++
library/js/libs/modernizr.custom.min.js | 4 +
library/js/scripts.js | 141 ++
library/pdf/Proposed_Apache-Spot_workflow.pdf | Bin 0 -> 263628 bytes
project-components/index.php | 0
project-components/ingestion/index.php | 67 +
project-components/machine-learning/index.php | 47 +
project-components/open-data-models/index.php | 60 +
project-components/visualization/index.php | 79 ++
tag/github/index.php | 57 +
tag/index.php | 0
tag/open-network-insight/index.php | 59 +
tag/open-source/index.php | 59 +
191 files changed, 7002 insertions(+)
diff --git a/.DS_Store b/.DS_Store
new file mode 100644
index 0000000..e14de31
Binary files /dev/null and b/.DS_Store differ
diff --git a/2016/03/index.php b/2016/03/index.php
new file mode 100755
index 0000000..943d6c9
--- /dev/null
+++ b/2016/03/index.php
@@ -0,0 +1,60 @@
+<?php include '../../includes/config.php'; ?>
+
+<?php
+$bodyclass = "archive date";
+$pageTitle = "March 2016 - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: March 2016</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/2016/08/index.php b/2016/08/index.php
new file mode 100755
index 0000000..f3fd605
--- /dev/null
+++ b/2016/08/index.php
@@ -0,0 +1,88 @@
+<?php include '../../includes/config.php'; ?>
+
+<?php
+$bodyclass = "archive date";
+$pageTitle = "August 2016 - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: August 2016</h1>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-thre [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../blog/how-apache-spot-helps-create-well-stocke [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/2016/09/index.php b/2016/09/index.php
new file mode 100755
index 0000000..5ec7cb5
--- /dev/null
+++ b/2016/09/index.php
@@ -0,0 +1,57 @@
+<?php include '../../includes/config.php'; ?>
+
+<?php
+$bodyclass = "archive date";
+$pageTitle = "September 2016 - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: September 2016</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read mor [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/2016/10/index.php b/2016/10/index.php
new file mode 100755
index 0000000..27ce039
--- /dev/null
+++ b/2016/10/index.php
@@ -0,0 +1,60 @@
+<?php include '../../includes/config.php'; ?>
+
+<?php
+$bodyclass = "archive date";
+$pageTitle = "October 2016 - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: October 2016</h1>
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../blog/strength-in-numbers-why-consider-open-source-cy [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/2016/index.php b/2016/index.php
new file mode 100755
index 0000000..e69de29
diff --git a/blog/apache-spot-3-most-asked-questions/feed/index.html b/blog/apache-spot-3-most-asked-questions/feed/index.html
new file mode 100755
index 0000000..7baf2ec
--- /dev/null
+++ b/blog/apache-spot-3-most-asked-questions/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot (Incubating): Three Most-Asked Questions</title>
+ <atom:link href="http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/apache-spot-3-most-asked-questions/index.php b/blog/apache-spot-3-most-asked-questions/index.php
new file mode 100755
index 0000000..f09a92e
--- /dev/null
+++ b/blog/apache-spot-3-most-asked-questions/index.php
@@ -0,0 +1,94 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "single single-post";
+$pageTitle = "Apache Spot (Incubating): Three Most-Asked Questions - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating): Three Most-Asked Questions</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.
+ </p>
+ <p>
+ <strong>What Is Apache Spot?</strong>
+ <br />
+ Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security [...]
+ </p>
+ <p>
+ We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an [...]
+ <br />
+ <a href="<?php echo BASE_URL; ?>/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="<?php echo BASE_URL; ?>/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a>
+ </p>
+ <p>
+ The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.
+ </p>
+ <p>
+ <strong>Why Intel?</strong>
+ </p>
+ <p>
+ At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some prett [...]
+ </p>
+ <p>
+ <strong>Why Open Source?</strong>
+ </p>
+ <p>
+ I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.
+ </p>
+ <p>
+ The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuo [...]
+ </p>
+ <p>
+ Fork us on Github!
+ </p>
+ <p>
+ Grant Babb
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/security-analytics/" rel="category tag">Security Analytics</a>
+ <p class="tags">
+ <span class="tags-title">Tags:</span><a href="../../tag/github/" rel="tag">github</a>, <a href="../../tag/open-network-insight/" rel="tag">open network insight</a>, <a href="../../tag/open-source/" rel="tag">open source</a>
+ </p>
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
new file mode 100755
index 0000000..3999b6d
--- /dev/null
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+ <atom:link href="http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.php b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.php
new file mode 100755
index 0000000..d32442d
--- /dev/null
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.php
@@ -0,0 +1,98 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "single single-post";
+$pageTitle = "Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each attack?
+ </p>
+ <p>
+ Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:
+ </p>
+ <ol>
+ <li>
+ Collect information from each device that is part of the environment.
+ </li>
+ <li>
+ Collect information from the critical infrastructure that is used for most, if not all, of the systems.
+ </li>
+ </ol>
+ <p>
+ This blog will describe the second approach.
+ </p>
+ <p>
+ Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or serv [...]
+ </p>
+ <p>
+ Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.
+ </p>
+ <p>
+ Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?
+ </p>
+ <p>
+ First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
+ </p>
+ <p>
+ Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
+ </p>
+ <p>
+ Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
+ </p>
+ <p>
+ <strong>But Wait, There’s More</strong>
+ </p>
+ <p>
+ Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
+ </p>
+ <p>
+ This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/cybersecurity/" rel="category tag">Cybersecurity</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html
new file mode 100755
index 0000000..04fbe33
--- /dev/null
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <atom:link href="http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.php b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.php
new file mode 100755
index 0000000..571915c
--- /dev/null
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.php
@@ -0,0 +1,80 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "single single-post";
+$pageTitle = "How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
+ </p>
+ <p>
+ Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
+ </p>
+ <a href="<?php echo BASE_URL; ?>/library/images/ONI_Architecture-Diagram_1300_v4.png"><img src="<?php echo BASE_URL; ?>/library/images/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" /></a>
+ <h3><strong>Apache Spot Core Components</strong></h3>
+ <p>
+ The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
+ </p>
+ <p>
+ In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
+ </p>
+ <h3><strong>Operational Analytics</strong></h3>
+ <p>
+ As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
+ </p>
+ <h3><strong>Visualizing Results</strong></h3>
+ <p>
+ The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
+ </p>
+ <h3><strong>Customizable Open Source</strong></h3>
+ <p>
+ Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/uncategorized/" rel="category tag">Uncategorized</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/blog/index.php b/blog/index.php
new file mode 100755
index 0000000..4537ac3
--- /dev/null
+++ b/blog/index.php
@@ -0,0 +1,153 @@
+<?php include '../includes/config.php'; ?>
+<?php
+$bodyclass = "blog";
+$pageTitle = "Apache Spot Blog";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="strength-in-numbers-why-consider-open-source-cybersecu [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="jupyter-notebooks-for-data-analysis" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more »</a>
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to- [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="how-apache-spot-helps-create-well-stocked-data- [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ </main>
+
+ <?php include '../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/blog/jupyter-notebooks-for-data-analysis/feed/index.html b/blog/jupyter-notebooks-for-data-analysis/feed/index.html
new file mode 100755
index 0000000..5022015
--- /dev/null
+++ b/blog/jupyter-notebooks-for-data-analysis/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Jupyter Notebooks for Data Analysis</title>
+ <atom:link href="http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.php b/blog/jupyter-notebooks-for-data-analysis/index.php
new file mode 100755
index 0000000..1931779
--- /dev/null
+++ b/blog/jupyter-notebooks-for-data-analysis/index.php
@@ -0,0 +1,128 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "single single-post";
+$pageTitle = "Jupyter Notebooks for Data Analysis - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Jupyter Notebooks for Data Analysis</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ <strong>Why Does Apache Spot Include iPython notebooks? </strong>
+ </p>
+ <p>
+ The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an i [...]
+ </p>
+ <p>
+ The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.
+ </p>
+ <p>
+ Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.
+ </p>
+ <img src="<?php echo BASE_URL;?>/library/images/iPython-1.png" alt="ipython" class="aligncenter size-full wp-image-140" />
+ <p>
+ <strong>IPython with Apache Spot for Network Threat Detection</strong>
+ </p>
+ <p>
+ <em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em>
+ </p>
+ <p>
+ Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to ge [...]
+ </p>
+ <p>
+ If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.
+ </p>
+ <p>
+ <strong><em>What? </em></strong>
+ </p>
+ <p>
+ Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.
+ </p>
+ <p>
+ <strong><em>Who?</em></strong>
+ </p>
+ <p>
+ Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a [...]
+ </p>
+ <p>
+ <strong><em>When?</em></strong>
+ </p>
+ <p>
+ To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.
+ </p>
+ <p>
+ <strong><em>Where?</em></strong>
+ </p>
+ <p>
+ When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.
+ </p>
+ <p>
+ <strong><em>Why?</em></strong>
+ </p>
+ <p>
+ This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.
+ </p>
+ <p>
+ <strong>How to Get Answers to the Five Ws Questions</strong>
+ </p>
+ <p>
+ All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.
+ </p>
+ <p>
+ Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.
+ </p>
+ <p>
+ <strong>Wrap Up</strong>
+ </p>
+ <p>
+ This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.
+ </p>
+ <p>
+ We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.
+ </p>
+ </section>
+
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/data-science/" rel="category tag">Data Science</a>, <a href="../../category/ipython-notebooks/" rel="category tag">Ipython Notebooks</a>, <a href="../../category/threat-analysis-tools/" rel="category tag">Threat Analysis Tools</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/index.html
new file mode 100755
index 0000000..ee2f59b
--- /dev/null
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
+ <atom:link href="http://spot.incubator.apache.org/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.php b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.php
new file mode 100755
index 0000000..c86b518
--- /dev/null
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.php
@@ -0,0 +1,69 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "single single-post";
+$pageTitle = "Strength in Numbers: Why Consider Open Source Cybersecurity Analytics - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics
+ </p>
+ <p>
+ Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on com [...]
+ </p>
+ <p>
+ This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often look [...]
+ </p>
+ <p>
+ By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve t [...]
+ </p>
+ <p>
+ By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leve [...]
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/uncategorized/" rel="category tag">Uncategorized</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/cybersecurity/index.php b/category/cybersecurity/index.php
new file mode 100755
index 0000000..1021e91
--- /dev/null
+++ b/category/cybersecurity/index.php
@@ -0,0 +1,59 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive category";
+$pageTitle = "Cybersecurity - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Cybersecurity</h1>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-thre [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php';?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php';?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/data-science/index.php b/category/data-science/index.php
new file mode 100755
index 0000000..5d57edb
--- /dev/null
+++ b/category/data-science/index.php
@@ -0,0 +1,59 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive category";
+$pageTitle = "Data Science - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Data Science</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/index.php b/category/index.php
new file mode 100755
index 0000000..e69de29
diff --git a/category/ipython-notebooks/index.php b/category/ipython-notebooks/index.php
new file mode 100755
index 0000000..008751f
--- /dev/null
+++ b/category/ipython-notebooks/index.php
@@ -0,0 +1,56 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive category";
+$pageTitle = "Ipython Notebooks - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Ipython Notebooks</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php';?>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/category/security-analytics/index.php b/category/security-analytics/index.php
new file mode 100755
index 0000000..fc4d27a
--- /dev/null
+++ b/category/security-analytics/index.php
@@ -0,0 +1,58 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive category";
+$pageTitle = "Security Analytics - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Security Analytics</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php';?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php';?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/threat-analysis-tools/index.php b/category/threat-analysis-tools/index.php
new file mode 100755
index 0000000..738d0ff
--- /dev/null
+++ b/category/threat-analysis-tools/index.php
@@ -0,0 +1,58 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive category";
+$pageTitle = "Threat Analysis Tools - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Threat Analysis Tools</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/uncategorized/index.php b/category/uncategorized/index.php
new file mode 100755
index 0000000..a727d75
--- /dev/null
+++ b/category/uncategorized/index.php
@@ -0,0 +1,85 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive category";
+$pageTitle = "Uncategorized - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Uncategorized</h1>
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../blog/strength-in-numbers-why-consider-open-source-cy [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../blog/how-apache-spot-helps-create-well-stocke [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/contribute/index.php b/contribute/index.php
new file mode 100755
index 0000000..aa92b45
--- /dev/null
+++ b/contribute/index.php
@@ -0,0 +1,86 @@
+<?php include '../includes/config.php'; ?>
+<?php
+$bodyclass = "page";
+$pageTitle = "Contribute - Apache Spot";
+$description = "";
+$currentPage = 'contribute';
+?>
+<?php include '../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Proposed Apache-Spot (incubating) Commit Workflow</h1>
+
+ <p><strong>NOTE: Most of this guide is based on ASF Documentation.</strong></p>
+
+ <p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.</p>
+
+ <p>Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
+
+ <h3 class="center" style="margin-top:35px;">Individual Push (most commonly used by the community):</h3>
+
+ <p><img src="<?php echo BASE_URL; ?>/library/images/individual-push.png" alt="" /></p>
+
+ <p><strong>Steps:</strong></p>
+
+ <ol>
+ <li>For the Github repository at <a href="https://github.com/apache/incubator-spot" target="_blank">https://github.com/apache/incubator-spot</a> if you haven't already. For more information about Fork please go to: <a href="https://help.github.com/articles/fork-a-repo/" target="_blank">https://help.github.com/articles/fork-a-repo/</a></li>
+ <li>Clone your fork, create a new branch named after a Jira issue (i.e. <strong>spot-100</strong>).</li>
+ <li>Push commits to your local branch.</li>
+ <li>Test it!!!</li>
+ <li>Create a pull request (PR) against the upstream repo (master) of apache-spot. For more information about how to create a pull request please go to: <a href="https://help.github.com/articles/about-pull-requests/" target="_blank">https://help.github.com/articles/about-pull-requests/</a>.</li>
+ <li>Wait for the maintainers to review your PR.</li>
+ </ol>
+
+ <h3 class="center" style="margin-top:35px;">Topic Branching (upstream)</h3>
+
+ <p>What are a topic branches?</p>
+
+ <blockquote>According to the git definition: "<em>A topic branch is a short-lived branch that you create and use for a single particular feature or related work.</em>" (<a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches</a>)</blockquote>
+
+ <p>Sometimes a new major feature will have dependencies between modules or developers that can't be separated into individual pushes, when this happens, a topic branch will be created to deliver the complete functionality before the merge with the upstream (encapsulated dev enviroment).</p>
+
+ <p>In order to create a topic branch, three requirements are needed:</p>
+
+ <ol>
+ <li>A design document must be uploaded using Jira. This design must be approved by the maintainers.</li>
+ <li>A voting process will be required to approve the topic branch creation, at least 3 maintainers need to approve it.</li>
+ <li>A commitment to delete the branch after merging it into the upstream branch must be done. The topic branch should only exist while the work is still in progress.</li>
+ </ol>
+
+ <p>A meaningful name must be given to the branch. It is recommended to use JIRA issue created with the design document to link the branch.</p>
+
+ <p><img src="<?php echo BASE_URL; ?>/library/images/topic-branching.png" alt="" /></p>
+
+ <p><strong>IMPORTANT: There shouldn't be a push without a Jira created previously</strong></p>
+
+ <h3>Approvals and Voting Process:</h3>
+
+ <blockquote>
+ <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
+
+ <p>Unless a vote has been declared as using <u>lazy consensus</u>, three +1 votes are required for a code-modification proposal to pass.</p>
+
+ <p>Whole numbers are recommended for this type of vote, as the opinion being expressed is Boolean: 'I approve/do not approve of this change.'</p>
+
+ <p><strong>Source: <a href="http://apache.org/foundation/voting.html" target="_blank">http://apache.org/foundation/voting.html</a></strong></p>
+ </blockquote>
+
+ <h3>Useful links:</h3>
+
+ <ul>
+ <li><a href="https://www.apache.org/foundation/glossary.html" target="_blank">https://www.apache.org/foundation/glossary.html</a></li>
+ <li><a href="http://www.apache.org/dev/committers" target="_blank">http://www.apache.org/dev/committers</a></li>
+ <li><a href="http://www.apache.org/dev/git.html" target="_blank">http://www.apache.org/dev/git.html</a></li>
+ <li><a href="http://www.apache.org/dev/writable-git" target="_blank">http://www.apache.org/dev/writable-git</a></li>
+ </ul>
+ </div>
+ </div>
+
+ </div>
+
+
+<?php include '../includes/prefooter.php'; ?>
+<?php include '../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/doc/css/meanmenu.css b/doc/css/meanmenu.css
new file mode 100755
index 0000000..3cf6e41
--- /dev/null
+++ b/doc/css/meanmenu.css
@@ -0,0 +1,170 @@
+
+/*! #######################################################################
+
+ MeanMenu 2.0.7
+ --------
+
+ To be used with jquery.meanmenu.js by Chris Wharton (http://www.meanthemes.com/plugins/meanmenu/)
+
+####################################################################### */
+
+/* hide the link until viewport size is reached */
+a.meanmenu-reveal {
+ display: none;
+}
+
+/* when under viewport size, .mean-container is added to body */
+.mean-container .mean-bar {
+ float: left;
+ width: 100%;
+ position: relative;
+ background: #e8e5e0;
+ padding: 4px 0;
+ min-height: 42px;
+ z-index: 999999;
+}
+
+.mean-container a.meanmenu-reveal {
+ width: 22px;
+ height: 22px;
+ padding: 13px 13px 11px 13px;
+ position: absolute;
+ top: 0;
+ right: 0;
+ cursor: pointer;
+ color: #c97644;
+ text-decoration: none;
+ font-size: 16px;
+ text-indent: -9999em;
+ line-height: 22px;
+ font-size: 1px;
+ display: block;
+ font-family: Arial, Helvetica, sans-serif;
+ font-weight: 700;
+}
+
+.mean-container a.meanmenu-reveal span {
+ display: block;
+ background: #c97644;
+ height: 3px;
+ margin-top: 3px;
+}
+
+.mean-container .mean-nav {
+ float: left;
+ width: 100%;
+ background: #e8e5e0;
+ margin-top: 44px;
+}
+
+.mean-container .mean-nav ul {
+ padding: 0;
+ margin: 0;
+ width: 100%;
+ list-style-type: none;
+ font-weight:600;
+}
+
+.mean-container .mean-nav ul li {
+ position: relative;
+ float: left;
+ width: 100%;
+ margin-bottom:0;
+}
+
+.mean-container .mean-nav ul li a {
+ display: block;
+ float: left;
+ width: 90%;
+ padding: 1em 5%;
+ margin: 0;
+ text-align: left;
+ color: #c97644;
+ border-top: 1px solid #c97644;
+ border-top: 1px solid rgba(255,255,255,0.8);
+ text-decoration: none;
+ text-transform: uppercase;
+}
+
+.mean-container .mean-nav ul li li a {
+ width: 80%;
+ padding: 1em 10%;
+ border-top: 1px solid #f1f1f1;
+ border-top: 1px solid rgba(255,255,255,0.25);
+/* opacity: 0.75;
+ filter: alpha(opacity=75);*/
+ text-shadow: none !important;
+ visibility: visible;
+}
+
+.mean-container .mean-nav ul li.mean-last a {
+ border-bottom: none;
+ margin-bottom: 0;
+}
+
+.mean-container .mean-nav ul li li li a {
+ width: 70%;
+ padding: 1em 15%;
+}
+
+.mean-container .mean-nav ul li li li li a {
+ width: 60%;
+ padding: 1em 20%;
+}
+
+.mean-container .mean-nav ul li li li li li a {
+ width: 50%;
+ padding: 1em 25%;
+}
+
+.mean-container .mean-nav ul li a:hover {
+ background: #252525;
+ background: rgba(255,255,255,0.1);
+}
+
+.mean-container .mean-nav ul li a.mean-expand {
+ margin-top: 1px;
+ width: 26px;
+ height: 32px;
+ padding:13px 12px 10px !important;
+ text-align: center;
+ position: absolute;
+ right: 0;
+ top: 0;
+ z-index: 2;
+ font-weight: 700;
+ background: rgba(255,255,255,0.1);
+ border: none !important;
+ border-left: 1px solid rgba(255,255,255,0.4) !important;
+ border-bottom: 1px solid rgba(255,255,255,0.2) !important;
+}
+
+.mean-container .mean-nav ul li a.mean-expand:hover {
+ background: #c97644;
+ color:#fff;
+}
+.mean-container .mean-push {
+ float: left;
+ width: 100%;
+ padding: 0;
+ margin: 0;
+ clear: both;
+}
+
+.mean-nav .wrapper {
+ width: 100%;
+ padding: 0;
+ margin: 0;
+}
+
+/* Fix for box sizing on Foundation Framework etc. */
+.mean-container .mean-bar, .mean-container .mean-bar * {
+ -webkit-box-sizing: content-box;
+ -moz-box-sizing: content-box;
+ box-sizing: content-box;
+}
+
+
+.mean-remove {
+ display: none !important;
+}
diff --git a/doc/css/style.css b/doc/css/style.css
new file mode 100755
index 0000000..f72d094
--- /dev/null
+++ b/doc/css/style.css
@@ -0,0 +1,547 @@
+@import url("https://fonts.googleapis.com/css?family=Roboto+Condensed:400,300,700");
+@import url("https://fonts.googleapis.com/css?family=Open+Sans:400,300,400italic,300italic,600,600italic,700,700italic,800,800italic");
+
+@font-face {
+ font-family: 'icomoon';
+ src: url('../fonts/icomoon.eot?z8h1zd');
+ src: url('../fonts/icomoon.eot?z8h1zd#iefix') format('embedded-opentype'),
+ url('../fonts/icomoon.ttf?z8h1zd') format('truetype'),
+ url('../fonts/icomoon.woff?z8h1zd') format('woff'),
+ url('../fonts/icomoon.svg?z8h1zd#icomoon') format('svg');
+ font-weight: normal;
+ font-style: normal;
+}
+
+[class^="icon-"], [class*=" icon-"] {
+ /* use !important to prevent issues with browser extensions that change fonts */
+ font-family: 'icomoon' !important;
+ speak: none;
+ font-style: normal;
+ font-weight: normal;
+ font-variant: normal;
+ text-transform: none;
+ line-height: 1;
+
+ /* Better Font Rendering =========== */
+ -webkit-font-smoothing: antialiased;
+ -moz-osx-font-smoothing: grayscale;
+}
+@font-face {
+ font-family: 'menu';
+ src: url('../fonts/menu.eot?799wtq');
+ src: url('../fonts/menu.eot?799wtq#iefix') format('embedded-opentype'),
+ url('../fonts/menu.ttf?799wtq') format('truetype'),
+ url('../fonts/menu.woff?799wtq') format('woff'),
+ url('../fonts/menu.svg?799wtq#menu') format('svg');
+ font-weight: normal;
+ font-style: normal;
+}
+
+[class^="menuicon-"], [class*=" menuicon-"] {
+ /* use !important to prevent issues with browser extensions that change fonts */
+ font-family: 'menu' !important;
+ speak: none;
+ font-style: normal;
+ font-weight: normal;
+ font-variant: normal;
+ text-transform: none;
+ line-height: 1;
+
+ /* Better Font Rendering =========== */
+ -webkit-font-smoothing: antialiased;
+ -moz-osx-font-smoothing: grayscale;
+}
+
+.menuicon-keyboard_arrow_right:before {
+ content: "\e900";
+}
+.menuicon-keyboard_arrow_left:before {
+ content: "\e901";
+}
+.menuicon-menu:before {
+ content: "\e9bd";
+}
+
+
+.icon-envelope:before {
+ content: "\e903";
+}
+.icon-twitter:before {
+ content: "\e901";
+}
+.icon-slack:before {
+ content: "\e909";
+}
+.icon-keyboard_arrow_right:before {
+ content: "\e900";
+}
+
+
+/* normalize.css 2012-07-07T09:50 UTC - http://github.com/necolas/normalize.css */
+/* ========================================================================== HTML5 display definitions ========================================================================== */
+/** Correct `block` display not defined in IE 8/9. */
+article, aside, details, figcaption, figure, footer, header, hgroup, main, nav, section, summary { display: block; }
+
+/** Correct `inline-block` display not defined in IE 8/9. */
+audio, canvas, video { display: inline-block; }
+
+/** Prevent modern browsers from displaying `audio` without controls. Remove excess height in iOS 5 devices. */
+audio:not([controls]) { display: none; height: 0; }
+
+/** Address `[hidden]` styling not present in IE 8/9. Hide the `template` element in IE, Safari, and Firefox < 22. */
+[hidden], template { display: none; }
+
+/* ========================================================================== Base ========================================================================== */
+/** 1. Set default font family to sans-serif. 2. Prevent iOS text size adjust after orientation change, without disabling user zoom. */
+html { font-family: sans-serif; /* 1 */ -ms-text-size-adjust: 100%; /* 2 */ -webkit-text-size-adjust: 100%; /* 2 */ }
+
+/** Remove default margin. */
+body { margin: 0; }
+
+/* ========================================================================== Links ========================================================================== */
+/** Remove the gray background color from active links in IE 10. */
+a { background: transparent; }
+
+/** Address `outline` inconsistency between Chrome and other browsers. */
+a:focus { outline: thin dotted; }
+
+/** Improve readability when focused and also mouse hovered in all browsers. */
+a:active, a:hover { outline: 0; }
+
+/* ========================================================================== Typography ========================================================================== */
+/** Address variable `h1` font-size and margin within `section` and `article` contexts in Firefox 4+, Safari 5, and Chrome. */
+h1 { font-size: 2em; margin: 0.67em 0; }
+
+/** Address styling not present in IE 8/9, Safari 5, and Chrome. */
+abbr[title] { border-bottom: 1px dotted; }
+
+/** Address style set to `bolder` in Firefox 4+, Safari 5, and Chrome. */
+b, strong, .strong { font-weight: bold; }
+
+/** Address styling not present in Safari 5 and Chrome. */
+dfn, em, .em { font-style: italic; }
+
+/** Address differences between Firefox and other browsers. */
+hr { -moz-box-sizing: content-box; box-sizing: content-box; height: 0; }
+
+/* proper formatting (http://blog.fontdeck.com/post/9037028497/hyphens)
+*/
+p { -webkit-hyphens: auto; -epub-hyphens: auto; -moz-hyphens: auto; hyphens: auto; }
+
+/* Addresses margins set differently in IE6/7. */
+pre { margin: 0; }
+
+/** Correct font family set oddly in Safari 5 and Chrome. */
+code, kbd, pre, samp { font-family: monospace, serif; font-size: 1em; }
+
+/** Improve readability of pre-formatted text in all browsers. */
+pre { white-space: pre-wrap; }
+
+/** Set consistent quote types. */
+q { quotes: "\201C" "\201D" "\2018" "\2019"; }
+
+/** Address inconsistent and variable font size in all browsers. */
+q:before, q:after { content: ''; content: none; }
+
+small, .small { font-size: 75%; }
+
+/** Prevent `sub` and `sup` affecting `line-height` in all browsers. */
+sub, sup { font-size: 75%; line-height: 0; position: relative; vertical-align: baseline; }
+
+sup { top: -0.5em; }
+
+sub { bottom: -0.25em; }
+
+/* ========================================================================== Lists
+========================================================================== */
+/* Addresses margins set differently in IE6/7. */
+dl, menu, ol, ul { margin: 1em 0; }
+
+dd { margin: 0; }
+
+/* Addresses paddings set differently in IE6/7. */
+menu { padding: 0 0 0 40px; }
+
+ol, ul { padding: 0; /*list-style-type: none;*/ }
+
+/* Corrects list images handled incorrectly in IE7. */
+nav ul, nav ol { list-style: none; list-style-image: none; }
+
+/* =============================================== Embedded content ========================================================================== */
+/** Remove border when inside `a` element in IE 8/9. */
+img { border: 0; }
+
+/** Correct overflow displayed oddly in IE 9. */
+svg:not(:root) { overflow: hidden; }
+
+/* ========================================================================== Figures ========================================================================== */
+/** Address margin not present in IE 8/9 and Safari 5. */
+figure { margin: 0; }
+
+/* ========================================================================== Forms ========================================================================== */
+/** Define consistent border, margin, and padding. */
+fieldset { border: 1px solid #c0c0c0; margin: 0 2px; padding: 0.35em 0.625em 0.75em; }
+
+/** 1. Correct `color` not being inherited in IE 8/9. 2. Remove padding so people aren't caught out if they zero out fieldsets. */
+legend { border: 0; /* 1 */ padding: 0; /* 2 */ }
+
+/** 1. Correct font family not being inherited in all browsers. 2. Correct font size not being inherited in all browsers. 3. Address margins set differently in Firefox 4+, Safari 5, and Chrome. */
+button, input, select, textarea { font-family: inherit; /* 1 */ font-size: 100%; /* 2 */ margin: 0; /* 3 */ }
+
+/** Address Firefox 4+ setting `line-height` on `input` using `!important` in the UA stylesheet. */
+button, input { line-height: normal; }
+
+/** Address inconsistent `text-transform` inheritance for `button` and `select`. All other form control elements do not inherit `text-transform` values. Correct `button` style inheritance in Chrome, Safari 5+, and IE 8+. Correct `select` style inheritance in Firefox 4+ and Opera. */
+button, select { text-transform: none; }
+
+/** 1. Avoid the WebKit bug in Android 4.0.* where (2) destroys native `audio` and `video` controls. 2. Correct inability to style clickable `input` types in iOS. 3. Improve usability and consistency of cursor style between image-type `input` and others. */
+button, html input[type="button"], input[type="reset"], input[type="submit"] { -webkit-appearance: button; /* 2 */ cursor: pointer; /* 3 */ }
+
+/** Re-set default cursor for disabled elements. */
+button[disabled], html input[disabled] { cursor: default; }
+
+/** 1. Address box sizing set to `content-box` in IE 8/9/10. 2. Remove excess padding in IE 8/9/10. */
+input[type="checkbox"], input[type="radio"] { box-sizing: border-box; /* 1 */ padding: 0; /* 2 */ }
+
+/** 1. Address `appearance` set to `searchfield` in Safari 5 and Chrome. 2. Address `box-sizing` set to `border-box` in Safari 5 and Chrome (include `-moz` to future-proof). */
+input[type="search"] { -webkit-appearance: textfield; /* 1 */ -moz-box-sizing: content-box; -webkit-box-sizing: content-box; /* 2 */ box-sizing: content-box; }
+
+/** Remove inner padding and search cancel button in Safari 5 and Chrome on OS X. */
+input[type="search"]::-webkit-search-cancel-button, input[type="search"]::-webkit-search-decoration { -webkit-appearance: none; }
+
+/** Remove inner padding and border in Firefox 4+. */
+button::-moz-focus-inner, input::-moz-focus-inner { border: 0; padding: 0; }
+
+/** 1. Remove default vertical scrollbar in IE 8/9. 2. Improve readability and alignment in all browsers. */
+textarea { overflow: auto; /* 1 */ vertical-align: top; /* 2 */ }
+
+/* ========================================================================== Tables ========================================================================== */
+/** Remove most spacing between table cells. */
+table { border-collapse: collapse; border-spacing: 0; }
+
+* { -webkit-box-sizing: border-box; -moz-box-sizing: border-box; box-sizing: border-box; }
+
+.image-replacement, .ir { text-indent: 100%; white-space: nowrap; overflow: hidden; }
+
+.clearfix, .cf, .comment-respond { zoom: 1; }
+.clearfix:before, .clearfix:after, .cf:before, .comment-respond:before, .cf:after, .comment-respond:after { content: ""; display: table; }
+.clearfix:after, .cf:after, .comment-respond:after { clear: both; }
+
+/*
+use the best ampersand
+http://simplebits.com/notebook/2008/08/14/ampersands-2/
+*/
+span.amp { font-family: Baskerville,'Goudy Old Style',Palatino,'Book Antiqua',serif !important; font-style: italic; }
+
+
+/*********************
+GRID STYLES
+*********************/
+.last-col { float: right; padding-right: 0 !important; }
+
+@media (max-width: 767px) { .m-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .m-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .m-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .m-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .m-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .m-3of4 { float: left; padding-right: 0.75em; width: 75%; } }
+/* Portrait tablet to landscape */
+@media (min-width: 768px) and (max-width: 1029px) { .t-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .t-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .t-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .t-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .t-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .t-3of4 { float: left; padding-right: 0.75em; width: 75%; }
+ .t-1of5 { float: left; padding-right: 0.75em; width: 20%; }
+ .t-2of5 { float: left; padding-right: 0.75em; width: 40%; }
+ .t-3of5 { float: left; padding-right: 0.75em; width: 60%; }
+ .t-4of5 { float: left; padding-right: 0.75em; width: 80%; } }
+/* Landscape to small desktop */
+@media (min-width: 1030px) { .d-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .d-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .d-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .d-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .d-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .d-3of4 { float: left; padding-right: 0.75em; width: 75%; }
+ .d-1of5 { float: left; padding-right: 0.75em; width: 20%; }
+ .d-2of5 { float: left; padding-right: 0.75em; width: 40%; }
+ .d-3of5 { float: left; padding-right: 0.75em; width: 60%; }
+ .d-4of5 { float: left; padding-right: 0.75em; width: 80%; }
+ .d-1of6 { float: left; padding-right: 0.75em; width: 16.6666666667%; }
+ .d-1of7 { float: left; padding-right: 0.75em; width: 14.2857142857%; }
+ .d-2of7 { float: left; padding-right: 0.75em; width: 28.5714286%; }
+ .d-3of7 { float: left; padding-right: 0.75em; width: 42.8571429%; }
+ .d-4of7 { float: left; padding-right: 0.75em; width: 57.1428572%; }
+ .d-5of7 { float: left; padding-right: 0.75em; width: 71.4285715%; }
+ .d-6of7 { float: left; padding-right: 0.75em; width: 85.7142857%; }
+ .d-1of8 { float: left; padding-right: 0.75em; width: 12.5%; }
+ .d-1of9 { float: left; padding-right: 0.75em; width: 11.1111111111%; }
+ .d-1of10 { float: left; padding-right: 0.75em; width: 10%; }
+ .d-1of11 { float: left; padding-right: 0.75em; width: 9.09090909091%; }
+ .d-1of12 { float: left; padding-right: 0.75em; width: 8.33%; } }
+
+
+/*********************
+GENERAL STYLES
+*********************/
+body { font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-size: 100%; line-height: 1.5; color: #0b0b0b; background-color: #f7f7f7; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; }
+
+p { -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; letter-spacing: 1px; line-height: 1.8em; font-size: 11pt; }
+
+ol {padding-left:20px;font-size:11pt;line-height:1.8em;letter-spacing:1px;}
+
+ul{padding-left:20px;list-style-image:url('../images/bullet.png');font-size:11pt;line-height:1.8em;letter-spacing:1px;}
+ul li {margin-bottom:10px;}
+
+img { max-width: 100%; height: auto; }
+
+.header { box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -webkit-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -moz-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); }
+
+.thin {font-weight:400;}
+
+.desktop {display:none;}
+
+
+/*********************
+LAYOUT
+*********************/
+.wrap { width: 85%; margin: 0 auto; }
+#mainwrap {position:relative;}
+
+/*********************
+PUSH MENU
+*********************/
+
+.cbp-spmenu button{position:absolute;top:5px;right:2px;margin:15px 5px 0 0;border:none;background-color:transparent;font-size:2em;color:#fff;text-indent:-999999px;background:url('../images/open.png')no-repeat;width:29px;height:30px;padding:0;}
+.cbp-spmenu.cbp-spmenu-open button {background:url('../images/close.png') no-repeat;}
+.cbp-spmenu{background:#d0cbc5;position:absolute;}
+.cbp-spmenu h3{color:#ffffff;font-size:1.9em;padding:20px 0 20px 20px;margin:0 0 15px;font-size:16pt;font-weight:500;text-transform:uppercase;font-family:'Open Sans',sans-serif;letter-spacing:0;}
+.cbp-spmenu-open h3 {background-color:#bfb8b0;}
+.cbp-spmenu a{display:block;color:#c77240;font-family:'Open Sans',sans-serif;text-transform:uppercase;font-weight:700;font-size:11pt}
+.cbp-spmenu a:active{background:#afdefa;color:#47a3da}
+.cbp-spmenu-vertical{width:240px;height:100%;top:0;z-index:1000}
+.cbp-spmenu-vertical a{padding:10px 10px 10px 20px}
+.cbp-spmenu-vertical .sub-menu{padding-bottom:5px}
+.cbp-spmenu-vertical ul{margin:0 0 20px;padding-left:20px}
+.cbp-spmenu-vertical ul > li > a{padding:0;color:#da8f56;text-transform:none;line-height:1.8em;font-weight:600}
+.cbp-spmenu-vertical ul > li > a:hover {color:#3e3e40;}
+.cbp-spmenu-vertical ul > li{margin:0;padding:0}
+.cbp-spmenu-left{left:-195px}
+.cbp-spmenu-left.cbp-spmenu-open{left:0}
+.cbp-spmenu,.cbp-spmenu-push{-webkit-transition:all .3s ease;-moz-transition:all .3s ease;transition:all .3s ease}
+
+
+/*********************
+BACK TO TOP
+*********************/
+.cd-container {
+ width: 90%;
+ max-width: 768px;
+ margin: 2em auto;
+}
+.cd-container::after {
+ /* clearfix */
+ content: '';
+ display: table;
+ clear: both;
+}
+.cd-top {
+ display: inline-block;
+ height: 40px;
+ width: 40px;
+ position: fixed;
+ bottom: 40px;
+ right: 10px;
+ box-shadow: 0 0 10px rgba(0, 0, 0, 0.05);
+ /* image replacement properties */
+ overflow: hidden;
+ text-indent: 100%;
+ white-space: nowrap;
+ background: rgba(201, 118, 68, 0.8) url('../images/cd-top-arrow.svg') no-repeat center 50%;
+ visibility: hidden;
+ opacity: 0;
+ -webkit-transition: opacity .3s 0s, visibility 0s .3s;
+ -moz-transition: opacity .3s 0s, visibility 0s .3s;
+ transition: opacity .3s 0s, visibility 0s .3s;
+}
+.cd-top.cd-is-visible, .cd-top.cd-fade-out, .no-touch .cd-top:hover {
+ -webkit-transition: opacity .3s 0s, visibility 0s 0s;
+ -moz-transition: opacity .3s 0s, visibility 0s 0s;
+ transition: opacity .3s 0s, visibility 0s 0s;
+}
+.cd-top.cd-is-visible {
+ /* the button becomes visible */
+ visibility: visible;
+ opacity: 1;
+}
+.cd-top.cd-fade-out {
+ /* if the user keeps scrolling down, the button is out of focus and becomes less visible */
+ opacity: .5;
+}
+.no-touch .cd-top:hover {
+ background-color: #c97644;
+ opacity: 1;
+}
+
+/******************************************************************
+H1, H2, H3, H4, H5 STYLES
+******************************************************************/
+h1, .h1, h2, .h2, h3, .h3, h4, .h4, h5, .h5 { text-rendering: optimizelegibility; font-weight: 500; color: #c97644;letter-spacing:2px; }
+
+h1 a, .h1 a, h2 a, .h2 a, h3 a, .h3 a, h4 a, .h4 a, h5 a, .h5 a { text-decoration: none; }
+
+h1, .h1 { font-size: 2.2em; line-height: 1.333em; }
+
+h2, .h2 { font-size: 1.75em; line-height: 1.4em; margin-bottom: 0.375em; }
+
+h3, .h3 { font-size: 1.125em; }
+
+h4, .h4 { font-size: 1.1em; font-weight: 700; }
+
+h5, .h5 { font-size: 0.846em; line-height: 2.09em; text-transform: uppercase; letter-spacing: 2px; }
+
+/*********************
+BUTTON STYLES
+*********************/
+.y-btn {display:inline-block;margin:0;}
+.y-btn, .y-btn:visited { background: transparent; padding: 10px 35px; border: 2px solid #c97644; color: #c97644; text-align:center;text-decoration: none; font-weight: bold; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; text-transform: uppercase; letter-spacing: 1px; font-size: 10.5pt; -webkit-transition: all .3s ease; -moz-transition: all .3s ease; -ms-transition: all .3s ease; -o-transition: all .3s ease; transition: all .3s ease; display:block;margin:0 auto [...]
+.y-btn:hover, .y-btn:focus, .y-btn:active, .y-btn:visited:hover, .y-btn:visited:focus, .y-btn:visited:active { background: #c97644; color: white; }
+
+
+/*********************
+LINK STYLES
+*********************/
+a, a:visited { color: #c97644; -webkit-transition: color .3s ease; -moz-transition: color .3s ease; -ms-transition: color .3s ease; -o-transition: color .3s ease; transition: color .3s ease; text-decoration: none; /* on hover */ /* on click */ /* mobile tap color */ }
+a:hover, a:focus, a:visited:hover, a:visited:focus { color: #3e3e40; }
+a:link, a:visited:link { /*
+this highlights links on iPhones/iPads.
+so it basically works like the :hover selector
+for mobile devices.
+*/ -webkit-tap-highlight-color: rgba(0, 0, 0, 0.3); }
+
+/*********************
+HEADER STYLES
+*********************/
+.header { background-color: white; }
+
+#logo { margin: 25px 0 15px; text-align: center; }
+#logo a { color: white; }
+
+#masthead { background: url("../images/masthead-bg.jpg") no-repeat bottom center; background-size: cover; clear: both; padding: 50px 0; -webkit-box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); text-align: center;min-height:250px;}
+#masthead h1 { color: #f9bf12; line-height: 1.2em; max-width: 600px; text-align: center; display: block; margin: 0 auto;color:#fff;font-weight:bold;letter-spacing:1px;}
+#masthead h1.thin {font-weight:400;}
+#masthead p { color: #fff; line-height: 1.8em; text-align: center; letter-spacing: 1px; font-size: 11pt; }
+#masthead .contribute h3 {color:#fff;letter-spacing:1px;font-size:1.3em;font-weight:500;}
+#masthead .btn-margin {text-align:center;margin:25px auto 0;max-width:250px;}
+#masthead .y-btn {padding:10px 15px;max-width:100%;color:#fff;border-color:#fff;}
+
+#masthead {text-align:center;}
+#masthead h1 {font-weight:400;}
+
+
+/*********************
+NAVIGATION STYLES
+*********************/
+.nav { border-bottom: 0; margin: 0; font-family: "Roboto", "Helvetica Neue", Helvetica, Arial, sans-serif; /* end .menu li */ /* highlight current page */ /* end current highlighters */ }
+
+.nav li a { display: block; color: white; text-decoration: none; padding: 0.75em; }
+
+.nav li ul.sub-menu li a, .nav li ul.children li a { padding-left: 30px; }
+.menu-item-has-children > a {cursor:default;}
+
+
+/*********************
+FOOTER STYLES
+*********************/
+#more-info { background: #4b4547; padding: 50px 0; }
+#more-info p { text-align: center; }
+
+.social-icons {text-align:center;margin-bottom:50px;}
+.social-icons a {font-size:2em;color:#fff;}
+.social-icons a:hover {color:#c97644;}
+.social-icons a:first-child {margin-right:15px;}
+
+.add-to-slack {margin:0 0 0 15px;}
+.add-to-slack {position:relative;top:5px;}
+
+#and .and-cell p {font-size:13pt;line-height:1.2em;}
+
+.citation {font-size:.7em;line-height:1.5em;margin:50px 0 15px;}
+
+.disclaimer {color:#fff;font-size:.7em;line-height:1.3em;}
+
+.footer { clear: both; background-color: #363132; color: #f8f9fa; min-height: 50px; }
+
+
+/************************
+ ORIGINAL STYLES
+*************************/
+img {height: auto;max-width: 100%;}
+p.terminal {background: #000000;border: 2px solid #000000;border-radius: 25px;color: #FFFFFF;margin-left: 50px;margin-right: 100px;padding: 20px;}
+table.configuration {margin-left: 20px;margin-right: 20px;width: 90%;}
+table.configuration th {background-color: #212F3C;color: white;}
+table.configuration td {padding: 8px;text-align: center;}
+table.configuration tr:nth-child(even) {background-color: #f2f2f2;}
+.sidenav {background-color: #212F3C;height: 100%;left: 0;overflow-x: hidden;padding-top: 60px;position: absolute;top: 0;transition: 0.5s;width: 200px;z-index: 1;}
+.sidenav a {color: #818181;display: block;font-size: 20px;padding: 8px 8px 8px 32px;text-decoration: none;transition: 0.3s;}
+.sidenav li {color: #818181;}
+.sidenav a:hover, .offcanvas a:focus {color: #f1f1f1;}
+.sidenav .closebtn {font-size: 36px;margin-left: 50px;position: absolute;right: 25px;top: 0;}
+#main {padding: 20px;margin-left:45px;transition: margin-left .5s;}
+
+#main {max-width:100%;overflow:hidden;}
+
+
+@media only screen and (min-width:768px) {
+ .wrap { width: 760px; }
+ #masthead {min-height:300px;}
+ #masthead .wrap {min-height:250px;}
+ #masthead .wrap { text-align: left; position:relative;min-height:550px;}
+ .contribute {position:absolute;bottom:0;right:0;max-width:500px;color:#fff;text-align:center;}
+ #masthead h1 { text-align: left; margin: 0; }
+ #masthead p { text-align: left; }
+ .page #masthead .wrap {min-height:250px;}
+ .page #masthead h1 {text-align:center;margin:0 auto;}
+}
+
+@media only screen and (min-width:1030px) {
+ .desktop {display:block;}
+ .mobile {display:none;}
+ .wrap { width: 1040px; }
+ #logo { float: left; text-align: left; }
+ .cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
+ .nav li a { padding: .75em 1.6em; }
+ .nav li:last-child a {padding-right:0;}
+ #masthead .wrap {min-height:360px;display: flex; justify-content: flex-end; align-items: center; align-content: flex-end;text-align:right;}
+ .cbp-spmenu {position:fixed;}
+
+ /********************* NAVIGATION STYLES ********************/
+ .nav { border: 0; float: right; margin-top: 35px; }
+ .nav ul { background: #e8e5e0; margin-top: 0; }
+ .nav li { float: left; position: relative; }
+ .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.5em;}
+ .nav li a:hover, .nav li a:focus { color: #c97644; }
+ .nav li.active > a {color:#c97644;}
+ .nav li ul.sub-menu, .nav li ul.children { margin-top: 0; position: absolute; visibility: hidden;opacity:0; z-index: 8999;padding-left:0; -webkit-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-moz-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-ms-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s; -o-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-i [...]
+
+ .nav li ul.sub-menu li a, .nav li ul.children li a { float:none;padding-left: 10px; border-right: 0; display: block; width: 235px; border-bottom: 1px solid #ccc; }
+ .nav li ul.sub-menu li a:hover, .nav li ul.children li a:hover {color:#c97644;}
+ .nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
+ .nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
+ .nav li:hover > ul { top: auto; visibility: visible; opacity:1;-moz-transform: translateY(0%);-webkit-transform: translateY(0%); -o-transform: translateY(0%);-ms-transform: translateY(0%); transform: translateY(0%); -webkit-transition-delay: 0s, 0s, 0.3s;-moz-transition-delay: 0s, 0s, 0.3s;-o-transition-delay: 0s, 0s, 0.3s;transition-delay: 0s, 0s, 0.3s;}
+}
+
+@media only screen and (min-width:1240px) {
+ body {margin-left:240px;}
+ .cbp-spmenu-left {left:0;}
+ .cbp-spmenu button {display:none;}
+ .cbp-spmenu h3 {background:#bfb8b0;padding:37px 25px;margin:5px;text-align:center;}
+ #masthead {min-height:350px;}
+}
+
+@media only screen and (min-width:1600px) {
+ #masthead{min-height:400px;}
+}
+@media only screen and (min-width:1920px) {
+ #masthead{min-height:400px;background-position:top -334px center;}
+}
\ No newline at end of file
diff --git a/doc/fonts/icomoon.eot b/doc/fonts/icomoon.eot
new file mode 100755
index 0000000..2b66be3
Binary files /dev/null and b/doc/fonts/icomoon.eot differ
diff --git a/doc/fonts/icomoon.svg b/doc/fonts/icomoon.svg
new file mode 100755
index 0000000..e8e5364
--- /dev/null
+++ b/doc/fonts/icomoon.svg
@@ -0,0 +1,14 @@
+<?xml version="1.0" standalone="no"?>
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd" >
+<svg xmlns="http://www.w3.org/2000/svg">
+<metadata>Generated by IcoMoon</metadata>
+<defs>
+<font id="icomoon" horiz-adv-x="1024">
+<font-face units-per-em="1024" ascent="960" descent="-64" />
+<missing-glyph horiz-adv-x="1024" />
+<glyph unicode=" " horiz-adv-x="512" d="" />
+<glyph unicode="" glyph-name="keyboard_arrow_right" d="M366 240.667l196 196-196 196 60 60 256-256-256-256z" />
+<glyph unicode="" glyph-name="twitter" d="M1024 733.6c-37.6-16.8-78.2-28-120.6-33 43.4 26 76.6 67.2 92.4 116.2-40.6-24-85.6-41.6-133.4-51-38.4 40.8-93 66.2-153.4 66.2-116 0-210-94-210-210 0-16.4 1.8-32.4 5.4-47.8-174.6 8.8-329.4 92.4-433 219.6-18-31-28.4-67.2-28.4-105.6 0-72.8 37-137.2 93.4-174.8-34.4 1-66.8 10.6-95.2 26.2 0-0.8 0-1.8 0-2.6 0-101.8 72.4-186.8 168.6-206-17.6-4.8-36.2-7.4-55.4-7.4-13.6 0-26.6 1.4-39.6 3.8 26.8-83.4 104.4-144.2 196.2-146-72-56.4-162.4-90-261-90-17 0 [...]
+<glyph unicode="" glyph-name="envelope" d="M1024 545.143v-453.714c0-50.286-41.143-91.429-91.429-91.429h-841.143c-50.286 0-91.429 41.143-91.429 91.429v453.714c17.143-18.857 36.571-35.429 57.714-49.714 94.857-64.571 190.857-129.143 284-197.143 48-35.429 107.429-78.857 169.714-78.857h1.143c62.286 0 121.714 43.429 169.714 78.857 93.143 67.429 189.143 132.571 284.571 197.143 20.571 14.286 40 30.857 57.143 49.714zM1024 713.143c0-64-47.429-121.714-97.714-156.571-89.143-61.714-178.857-12 [...]
+<glyph unicode="" glyph-name="slack" horiz-adv-x="951" d="M868 507.428c46.857 0 82.857-34.286 82.857-81.143 0-36.571-18.857-62.286-53.143-74.286l-98.286-33.714 32-95.429c2.857-8.571 4-17.714 4-26.857 0-45.143-36.571-82.857-81.714-82.857-36 0-68 22.286-79.429 56.571l-31.429 94.286-177.143-60.571 31.429-93.714c2.857-8.571 4.571-17.714 4.571-26.857 0-44.571-36.571-82.857-82.286-82.857-36 0-67.429 22.286-78.857 56.571l-31.429 93.143-87.429-30.286c-9.143-2.857-18.857-5.143-28.571-5.14 [...]
+</font></defs></svg>
\ No newline at end of file
diff --git a/doc/fonts/icomoon.ttf b/doc/fonts/icomoon.ttf
new file mode 100755
index 0000000..3da8f63
Binary files /dev/null and b/doc/fonts/icomoon.ttf differ
diff --git a/doc/fonts/icomoon.woff b/doc/fonts/icomoon.woff
new file mode 100755
index 0000000..ef7be06
Binary files /dev/null and b/doc/fonts/icomoon.woff differ
diff --git a/doc/fonts/menu.eot b/doc/fonts/menu.eot
new file mode 100755
index 0000000..b0921cf
Binary files /dev/null and b/doc/fonts/menu.eot differ
diff --git a/doc/fonts/menu.svg b/doc/fonts/menu.svg
new file mode 100755
index 0000000..e7856c8
--- /dev/null
+++ b/doc/fonts/menu.svg
@@ -0,0 +1,13 @@
+<?xml version="1.0" standalone="no"?>
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd" >
+<svg xmlns="http://www.w3.org/2000/svg">
+<metadata>Generated by IcoMoon</metadata>
+<defs>
+<font id="menu" horiz-adv-x="1024">
+<font-face units-per-em="1024" ascent="960" descent="-64" />
+<missing-glyph horiz-adv-x="1024" />
+<glyph unicode=" " horiz-adv-x="512" d="" />
+<glyph unicode="" glyph-name="keyboard_arrow_right" d="M366 240.667l196 196-196 196 60 60 256-256-256-256z" />
+<glyph unicode="" glyph-name="keyboard_arrow_left" d="M658 252.667l-60-60-256 256 256 256 60-60-196-196z" />
+<glyph unicode="" glyph-name="menu" d="M64 768h896v-192h-896zM64 512h896v-192h-896zM64 256h896v-192h-896z" />
+</font></defs></svg>
\ No newline at end of file
diff --git a/doc/fonts/menu.ttf b/doc/fonts/menu.ttf
new file mode 100755
index 0000000..9baa5e9
Binary files /dev/null and b/doc/fonts/menu.ttf differ
diff --git a/doc/fonts/menu.woff b/doc/fonts/menu.woff
new file mode 100755
index 0000000..37ad30b
Binary files /dev/null and b/doc/fonts/menu.woff differ
diff --git a/doc/images/1.1_dns_sb01.jpg b/doc/images/1.1_dns_sb01.jpg
new file mode 100755
index 0000000..d6956e5
Binary files /dev/null and b/doc/images/1.1_dns_sb01.jpg differ
diff --git a/doc/images/1.1_dns_sb02.jpg b/doc/images/1.1_dns_sb02.jpg
new file mode 100755
index 0000000..fe85356
Binary files /dev/null and b/doc/images/1.1_dns_sb02.jpg differ
diff --git a/doc/images/1.1_dns_sc01.jpg b/doc/images/1.1_dns_sc01.jpg
new file mode 100755
index 0000000..fcecb5e
Binary files /dev/null and b/doc/images/1.1_dns_sc01.jpg differ
diff --git a/doc/images/1.1_dns_ti01.jpg b/doc/images/1.1_dns_ti01.jpg
new file mode 100755
index 0000000..154a62c
Binary files /dev/null and b/doc/images/1.1_dns_ti01.jpg differ
diff --git a/doc/images/1.1_dns_ti02.png b/doc/images/1.1_dns_ti02.png
new file mode 100755
index 0000000..deddadb
Binary files /dev/null and b/doc/images/1.1_dns_ti02.png differ
diff --git a/doc/images/1.1_dns_ti03.jpg b/doc/images/1.1_dns_ti03.jpg
new file mode 100755
index 0000000..90ae153
Binary files /dev/null and b/doc/images/1.1_dns_ti03.jpg differ
diff --git a/doc/images/1.1_dns_ti04.jpg b/doc/images/1.1_dns_ti04.jpg
new file mode 100755
index 0000000..aae4a8c
Binary files /dev/null and b/doc/images/1.1_dns_ti04.jpg differ
diff --git a/doc/images/1.1_dns_ti05.jpg b/doc/images/1.1_dns_ti05.jpg
new file mode 100755
index 0000000..d86cc13
Binary files /dev/null and b/doc/images/1.1_dns_ti05.jpg differ
diff --git a/doc/images/1.1_proxy_sb01.jpg b/doc/images/1.1_proxy_sb01.jpg
new file mode 100755
index 0000000..14f4257
Binary files /dev/null and b/doc/images/1.1_proxy_sb01.jpg differ
diff --git a/doc/images/1.1_proxy_sb02.jpg b/doc/images/1.1_proxy_sb02.jpg
new file mode 100755
index 0000000..f1aea3c
Binary files /dev/null and b/doc/images/1.1_proxy_sb02.jpg differ
diff --git a/doc/images/1.1_proxy_sb03.jpg b/doc/images/1.1_proxy_sb03.jpg
new file mode 100755
index 0000000..ee03c97
Binary files /dev/null and b/doc/images/1.1_proxy_sb03.jpg differ
diff --git a/doc/images/1.1_proxy_sb04.jpg b/doc/images/1.1_proxy_sb04.jpg
new file mode 100755
index 0000000..5a8c9df
Binary files /dev/null and b/doc/images/1.1_proxy_sb04.jpg differ
diff --git a/doc/images/1.1_proxy_sb05.jpg b/doc/images/1.1_proxy_sb05.jpg
new file mode 100755
index 0000000..5cf6675
Binary files /dev/null and b/doc/images/1.1_proxy_sb05.jpg differ
diff --git a/doc/images/1.1_proxy_sb06.jpg b/doc/images/1.1_proxy_sb06.jpg
new file mode 100755
index 0000000..ffb80e2
Binary files /dev/null and b/doc/images/1.1_proxy_sb06.jpg differ
diff --git a/doc/images/1.1_proxy_sc01.jpg b/doc/images/1.1_proxy_sc01.jpg
new file mode 100755
index 0000000..4ea5a27
Binary files /dev/null and b/doc/images/1.1_proxy_sc01.jpg differ
diff --git a/doc/images/1.1_proxy_sc02.jpg b/doc/images/1.1_proxy_sc02.jpg
new file mode 100755
index 0000000..2b506c6
Binary files /dev/null and b/doc/images/1.1_proxy_sc02.jpg differ
diff --git a/doc/images/1.1_proxy_sc03.jpg b/doc/images/1.1_proxy_sc03.jpg
new file mode 100755
index 0000000..8f52a34
Binary files /dev/null and b/doc/images/1.1_proxy_sc03.jpg differ
diff --git a/doc/images/1.1_proxy_sc04.jpg b/doc/images/1.1_proxy_sc04.jpg
new file mode 100755
index 0000000..551060b
Binary files /dev/null and b/doc/images/1.1_proxy_sc04.jpg differ
diff --git a/doc/images/1.1_proxy_sc05.jpg b/doc/images/1.1_proxy_sc05.jpg
new file mode 100755
index 0000000..d824f92
Binary files /dev/null and b/doc/images/1.1_proxy_sc05.jpg differ
diff --git a/doc/images/1.1_proxy_sc06.jpg b/doc/images/1.1_proxy_sc06.jpg
new file mode 100755
index 0000000..242e9a8
Binary files /dev/null and b/doc/images/1.1_proxy_sc06.jpg differ
diff --git a/doc/images/1.1_proxy_sc07.jpg b/doc/images/1.1_proxy_sc07.jpg
new file mode 100755
index 0000000..51afd5f
Binary files /dev/null and b/doc/images/1.1_proxy_sc07.jpg differ
diff --git a/doc/images/1.1_proxy_sc08.jpg b/doc/images/1.1_proxy_sc08.jpg
new file mode 100755
index 0000000..82bd641
Binary files /dev/null and b/doc/images/1.1_proxy_sc08.jpg differ
diff --git a/doc/images/1.1_proxy_sc09.jpg b/doc/images/1.1_proxy_sc09.jpg
new file mode 100755
index 0000000..0980086
Binary files /dev/null and b/doc/images/1.1_proxy_sc09.jpg differ
diff --git a/doc/images/1.1_proxy_sc10.jpg b/doc/images/1.1_proxy_sc10.jpg
new file mode 100755
index 0000000..84733f1
Binary files /dev/null and b/doc/images/1.1_proxy_sc10.jpg differ
diff --git a/doc/images/1.1_proxy_ti01.jpg b/doc/images/1.1_proxy_ti01.jpg
new file mode 100755
index 0000000..5d96c33
Binary files /dev/null and b/doc/images/1.1_proxy_ti01.jpg differ
diff --git a/doc/images/1.1_proxy_ti02.jpg b/doc/images/1.1_proxy_ti02.jpg
new file mode 100755
index 0000000..d7cd367
Binary files /dev/null and b/doc/images/1.1_proxy_ti02.jpg differ
diff --git a/doc/images/1.1_proxy_ti03.jpg b/doc/images/1.1_proxy_ti03.jpg
new file mode 100755
index 0000000..4ba5a18
Binary files /dev/null and b/doc/images/1.1_proxy_ti03.jpg differ
diff --git a/doc/images/1.1_proxy_ti04.jpg b/doc/images/1.1_proxy_ti04.jpg
new file mode 100755
index 0000000..1edcfb1
Binary files /dev/null and b/doc/images/1.1_proxy_ti04.jpg differ
diff --git a/doc/images/1.1_sc10.jpg b/doc/images/1.1_sc10.jpg
new file mode 100755
index 0000000..dc42cf6
Binary files /dev/null and b/doc/images/1.1_sc10.jpg differ
diff --git a/doc/images/1.1_sc2.jpg b/doc/images/1.1_sc2.jpg
new file mode 100755
index 0000000..a6f26b9
Binary files /dev/null and b/doc/images/1.1_sc2.jpg differ
diff --git a/doc/images/1.1_sc3.jpg b/doc/images/1.1_sc3.jpg
new file mode 100755
index 0000000..ecac266
Binary files /dev/null and b/doc/images/1.1_sc3.jpg differ
diff --git a/doc/images/1.1_sc4.jpg b/doc/images/1.1_sc4.jpg
new file mode 100755
index 0000000..0ac103b
Binary files /dev/null and b/doc/images/1.1_sc4.jpg differ
diff --git a/doc/images/1.1_sc5.jpg b/doc/images/1.1_sc5.jpg
new file mode 100755
index 0000000..5ec881d
Binary files /dev/null and b/doc/images/1.1_sc5.jpg differ
diff --git a/doc/images/1.1_sc6.jpg b/doc/images/1.1_sc6.jpg
new file mode 100755
index 0000000..a9e0a89
Binary files /dev/null and b/doc/images/1.1_sc6.jpg differ
diff --git a/doc/images/1.1_sc7.jpg b/doc/images/1.1_sc7.jpg
new file mode 100755
index 0000000..691cb31
Binary files /dev/null and b/doc/images/1.1_sc7.jpg differ
diff --git a/doc/images/1.1_sc8.jpg b/doc/images/1.1_sc8.jpg
new file mode 100755
index 0000000..e81d89b
Binary files /dev/null and b/doc/images/1.1_sc8.jpg differ
diff --git a/doc/images/1.1_sc9.jpg b/doc/images/1.1_sc9.jpg
new file mode 100755
index 0000000..432ca04
Binary files /dev/null and b/doc/images/1.1_sc9.jpg differ
diff --git a/doc/images/1.1_technical_overviewv02.jpg b/doc/images/1.1_technical_overviewv02.jpg
new file mode 100755
index 0000000..09451ed
Binary files /dev/null and b/doc/images/1.1_technical_overviewv02.jpg differ
diff --git a/doc/images/1.1_ti01.jpg b/doc/images/1.1_ti01.jpg
new file mode 100755
index 0000000..4368996
Binary files /dev/null and b/doc/images/1.1_ti01.jpg differ
diff --git a/doc/images/1.1_ti02.jpg b/doc/images/1.1_ti02.jpg
new file mode 100755
index 0000000..39f1c81
Binary files /dev/null and b/doc/images/1.1_ti02.jpg differ
diff --git a/doc/images/1.1_ti03.jpg b/doc/images/1.1_ti03.jpg
new file mode 100755
index 0000000..25c7d37
Binary files /dev/null and b/doc/images/1.1_ti03.jpg differ
diff --git a/doc/images/1.1sc1.jpg b/doc/images/1.1sc1.jpg
new file mode 100755
index 0000000..9fe9280
Binary files /dev/null and b/doc/images/1.1sc1.jpg differ
diff --git a/doc/images/add-to-slack.png b/doc/images/add-to-slack.png
new file mode 100755
index 0000000..9f15e5e
Binary files /dev/null and b/doc/images/add-to-slack.png differ
diff --git a/doc/images/apache-incubator.png b/doc/images/apache-incubator.png
new file mode 100755
index 0000000..0b44446
Binary files /dev/null and b/doc/images/apache-incubator.png differ
diff --git a/doc/images/apple-touch-icon.png b/doc/images/apple-touch-icon.png
new file mode 100755
index 0000000..b561378
Binary files /dev/null and b/doc/images/apple-touch-icon.png differ
diff --git a/doc/images/cd-top-arrow.svg b/doc/images/cd-top-arrow.svg
new file mode 100755
index 0000000..5468d98
--- /dev/null
+++ b/doc/images/cd-top-arrow.svg
@@ -0,0 +1,7 @@
+<?xml version="1.0" encoding="utf-8"?>
+<!-- Generator: Adobe Illustrator 17.1.0, SVG Export Plug-In . SVG Version: 6.00 Build 0) -->
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
+<svg version="1.1" id="Layer_1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" x="0px" y="0px"
+ width="16px" height="16px" viewBox="0 0 16 16" enable-background="new 0 0 16 16" xml:space="preserve">
+<polygon fill="#FFFFFF" points="8,2.8 16,10.7 13.6,13.1 8.1,7.6 2.5,13.2 0,10.7 "/>
+</svg>
diff --git a/doc/images/close.png b/doc/images/close.png
new file mode 100755
index 0000000..f90d89c
Binary files /dev/null and b/doc/images/close.png differ
diff --git a/doc/images/dns_sb_tit1.JPG b/doc/images/dns_sb_tit1.JPG
new file mode 100755
index 0000000..096aab9
Binary files /dev/null and b/doc/images/dns_sb_tit1.JPG differ
diff --git a/doc/images/flow_sb_1.JPG b/doc/images/flow_sb_1.JPG
new file mode 100755
index 0000000..f4f29e8
Binary files /dev/null and b/doc/images/flow_sb_1.JPG differ
diff --git a/doc/images/flow_sb_2.JPG b/doc/images/flow_sb_2.JPG
new file mode 100755
index 0000000..b3501df
Binary files /dev/null and b/doc/images/flow_sb_2.JPG differ
diff --git a/doc/images/flow_sb_3.JPG b/doc/images/flow_sb_3.JPG
new file mode 100755
index 0000000..a3cbc03
Binary files /dev/null and b/doc/images/flow_sb_3.JPG differ
diff --git a/doc/images/flow_sb_4.JPG b/doc/images/flow_sb_4.JPG
new file mode 100755
index 0000000..a7d3114
Binary files /dev/null and b/doc/images/flow_sb_4.JPG differ
diff --git a/doc/images/flow_sb_4b.JPG b/doc/images/flow_sb_4b.JPG
new file mode 100755
index 0000000..0b7b97d
Binary files /dev/null and b/doc/images/flow_sb_4b.JPG differ
diff --git a/doc/images/flow_sb_5.JPG b/doc/images/flow_sb_5.JPG
new file mode 100755
index 0000000..6fa8469
Binary files /dev/null and b/doc/images/flow_sb_5.JPG differ
diff --git a/doc/images/flow_sb_6.JPG b/doc/images/flow_sb_6.JPG
new file mode 100755
index 0000000..0fe2b0d
Binary files /dev/null and b/doc/images/flow_sb_6.JPG differ
diff --git a/doc/images/hybrid_hadoop.bmp b/doc/images/hybrid_hadoop.bmp
new file mode 100755
index 0000000..29ade30
Binary files /dev/null and b/doc/images/hybrid_hadoop.bmp differ
diff --git a/doc/images/is1.png b/doc/images/is1.png
new file mode 100755
index 0000000..69c27e7
Binary files /dev/null and b/doc/images/is1.png differ
diff --git a/doc/images/is2.png b/doc/images/is2.png
new file mode 100755
index 0000000..d6e3ee2
Binary files /dev/null and b/doc/images/is2.png differ
diff --git a/doc/images/logo.png b/doc/images/logo.png
new file mode 100755
index 0000000..1bf9f68
Binary files /dev/null and b/doc/images/logo.png differ
diff --git a/doc/images/masthead-bg.jpg b/doc/images/masthead-bg.jpg
new file mode 100755
index 0000000..c5179e2
Binary files /dev/null and b/doc/images/masthead-bg.jpg differ
diff --git a/doc/images/open.png b/doc/images/open.png
new file mode 100755
index 0000000..9f2fa17
Binary files /dev/null and b/doc/images/open.png differ
diff --git a/doc/images/pure_hadoop.bmp b/doc/images/pure_hadoop.bmp
new file mode 100755
index 0000000..311d0b5
Binary files /dev/null and b/doc/images/pure_hadoop.bmp differ
diff --git a/doc/images/sb_tit1.JPG b/doc/images/sb_tit1.JPG
new file mode 100755
index 0000000..e37b39f
Binary files /dev/null and b/doc/images/sb_tit1.JPG differ
diff --git a/doc/images/win8-tile-icon.png b/doc/images/win8-tile-icon.png
new file mode 100755
index 0000000..2392bed
Binary files /dev/null and b/doc/images/win8-tile-icon.png differ
diff --git a/doc/index.html b/doc/index.html
new file mode 100755
index 0000000..91799f3
--- /dev/null
+++ b/doc/index.html
@@ -0,0 +1,1444 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot (incubating) Documentation</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="images/apple-touch-icon.png">
+ <link rel="icon" href="favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="images/win8-tile-icon.png">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' href='css/style.css' type='text/css' media='all' />
+
+ <link rel='stylesheet' id='mm-css-css' href='css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='js/jquery.meanmenu.js'></script>
+
+ </head>
+
+ <body>
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="images/logo.png" alt="Apache Spot" /></a>
+ </p>
+ <div class="desktop">
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li class="menu-item">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li class="menu-item">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li class="menu-item">
+ <a href="http://spot.incubator.apache.org/contribute">Contribute</a>
+ </li>
+ <li class="menu-item">
+ <a href="http://spot.incubator.apache.org/doc/">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="http://spot.incubator.apache.org/project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="http://spot.incubator.apache.org/project-components/ingestion">Ingestion</a></li>
+ <li><a href="http://spot.incubator.apache.org/project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="http://spot.incubator.apache.org/project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li class="menu-item">
+ <a href="http://spot.incubator.apache.org/blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+ </div>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="masthead"></div>
+
+ <div id="mainwrap">
+ <nav class="cbp-spmenu cbp-spmenu-vertical cbp-spmenu-left" id="cbp-spmenu-s1">
+
+ <button id="showLeft"><span class="menuicon-menu"></span></button>
+
+ <h3>Documents</h3>
+ <a href="#introduction">Introduction <span class="icon-keyboard_arrow_right"></span></a>
+ <a href="#environment">Environment <span class="icon-keyboard_arrow_right"></span></a>
+ <a href="#installation" class="sub-menu">Installation <span class="icon-keyboard_arrow_right"></span></a>
+ <ul>
+ <li><a href="#cdh">CDH Requirements</a></li>
+ <li><a href="#deployment">Deployment</a> </li>
+ <li><a href="#configuration">Configuration</a></li>
+ <li><a href="#ingest">Ingest</a></li>
+ <li><a href="#ml">Machine Learning</a></li>
+ <li><a href="#oa">OA</a></li>
+ </ul>
+ <a href="#userguide" class="sub-menu">User Guide <span class="icon-keyboard_arrow_right"></span></a>
+ <ul>
+ <li><a href="#uflow">Flow</a></li>
+ <li><a href="#udns">DNS</a> </li>
+ <li><a href="#uproxy">Proxy</a></li>
+ </ul>
+
+ </nav>
+
+ <div id="main">
+ <div id="introduction">
+ <h1>Introduction</h1>
+ <p>
+ Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.
+ <br>
+ </p>
+ <img src="images/1.1_technical_overviewv02.jpg" width="95%"><br><br>
+ <h3>Parallel Ingest Framework.</h3>
+ <p>
+ The system uses decoders optimized from open source, that decodes binary flow and packet data, then loading the data in HDFS and data structures inside Hadoop. The decoded data is stored in multiple formats so it is available for searching, used by machine learning, transfer to law enforcement, or inputs to other systems.
+ </p>
+ <h3>Machine Learning.</h3>
+ <p>
+ The system uses a combination of Apache Spark to run scalable machine learning algorithms. The machine learning component works not only as a filter for separating bad traffic from benign, but also as a way to characterize the unique behavior of network traffic in an organization.
+ </p>
+ <h3>Operational Analytics.</h3>
+ <p>
+ In addition to machine learning, a proven process of context enrichment, noise filtering, whitelisting, and heuristics are applied to network data to produce a short list of the most likely patterns, which may be security threats.<br><br>
+ </p>
+ </div>
+ <div id="environment">
+ <h1>Environment</h1>
+ <h3>PURE HADOOP</h3>
+ <p>
+ Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the recommended deployment of CDH (see diagram below).<br><br>
+
+ This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.<br><br>
+ </p>
+ <img src="images/pure_hadoop.bmp" width="95%"><br><br>
+
+ <p>
+ In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource manage [...]
+
+ Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly <br><br>
+ </p>
+ <h3>Hybrid Hadoop</h3>
+
+ <p>
+ On existing Hadoop installations, a different approach involves using additional virtual machines and interacting with Hadoop components (Spark, HDFS) through a gateway node. This approach is recommended for customers with a Hadoop environment hosting heterogeneous use cases, where minimal deviation from node roles is desired. The disadvantage is that virtual machines must be sized properly according to workloads.<br><br>
+ </p>
+ <img src="images/hybrid_hadoop.bmp" width="95%"><br><br>
+
+ <p>
+ In addition to the services deployed on the existing cluster, additional Virtual Machines (VMs) are required to host the non-Hadoop functions of the solution. The gateway service is required for some of these VMs to allow for interaction with Spark, Hive, and HDFS.<br><br>
+ </p>
+
+ <b>Note:</b> While the above condition is a recommended layout for production, pilot deployments may be chosen to combine the above roles into fewer VMs. Each component of the Apache Spot (incubating) solution has integral interactions with Hadoop, but its non-Hadoop processing and memory requirements are separable with this approach.<br><br>
+
+ </div>
+ <div id="installation">
+ <h1>Installation</h1>
+ <div id="cdh">
+
+ This installation guide assumes that a cluster with HDFS is running CDH.<br>
+ <h2>1. CDH (Cloudera Distribution of Hadoop) Requirements:</h2>
+ <b>Minimum required version:</b> 5.4<br>
+ <b>NOTE:</b> Spot requires spark 1.6, if you are using CDH < 5.7 please upgrade your spark version to 1.6.
+ <h3>Required Hadoop Services before install apache spot (incubating):</h3>
+ <ol>
+ <li>HDFS.</li>
+ <li>HIVE.</li>
+ <li>IMPALA.</li>
+ <li>KAFKA.</li>
+ <li>SPARK (YARN).</li>
+ <li>YARN.</li>
+ <li>Zookeeper.</li>
+ </ol>
+ </div>
+ <div id="deployment">
+ <h2>2. Deployment Recommendations</h2>
+ There are four components in apache spot (incubating):
+ <ul>
+ <li><b>spot-setup</b> — scripts that create the required HDFS paths, hive tables and configuration for apache spot (incubating).</li>
+ <li><b>spot-ingest</b> — binary and log files are captured or transferred into the Hadoop cluster, where they are transformed and loaded into solution data stores.</li>
+ <li><b>spot-ml</b> — machine learning algorithms are used to add additional learning information to the ingest data, which is used to filter and sort raw data.</li>
+ <li><b>spot-oa</b>— data output from the machine learning component is augmented with context and heuristics, then is available to the user for interacting with it.</li>
+ </ul>
+ While all of the components can be installed on the same server in a development or test scenario, the recommended configuration for production is to map the components to specific server roles in a Hadoop cluster.<br><br>
+ <table class="configuration">
+ <tr>
+ <th>Component</th>
+ <th>Node</th>
+ </tr>
+ <tr>
+ <td>spot-setup</td>
+ <td>Edge Server (Gateway)</td>
+ </tr>
+ <tr>
+ <td>spot-ingest</td>
+ <td>Edge Server (Gateway)</td>
+ </tr>
+ <tr>
+ <td>spot-ml</td>
+ <td>YARN Node Manager</td>
+ </tr>
+ <tr>
+ <td>spot-oa</td>
+ <td>Node with Cloudera Manager</td>
+ </tr>
+ </table>
+ </div>
+ <div id="configuration">
+ <h2>3. Configuring the cluster.</h2>
+ <h3>3.1 Create a user account for apache spot (incubating).</h3>
+ <p>
+ Before starting the installation,
+ the recommended approach is to create a user account with super user privileges (sudo)
+ and with access to HDFS in each one of the nodes where apache spot (incubating) is going to be installed ( i.e. edge server, yarn node).<br>
+ </p>
+
+ <b>Add user to all apache spot (incubating) nodes:</b><br><br>
+ <p class="terminal">
+ sudo adduser <solution-user><br>
+ passwd <solution-user>
+ </p><br>
+
+ <b>Add user to HDFS supergroup (IMPORTANT: this should be done in the Name Node) :</b><br><br>
+ <p class="terminal">
+ sudo usermod -G supergroup $username
+ </p><br>
+
+ <h3>3.2 Get the code.</h3>
+ Go to the home directory of the solution user in the node assigned for spot-setup and spot-ingest and clone the code:<br><br>
+ <p class="terminal">
+ git clone https://github.com/apache/incubator-spot.git
+ </p><br>
+
+ <h3>3.3 Edit apache spot (incubating) configuration.</h3>
+ Go to apache spot (incubating) configuration module to edit the solution configuration:<br><br>
+ <p class="terminal">
+ cd /home/solution_user/incubator-spot/spot-setup<br>
+ vi spot.conf
+ </p><br>
+
+ Configuration variables of apache spot (incubating):<br><br>
+ <table class="configuration">
+ <tr>
+ <th>Key</th>
+ <th>Value</th>
+ <th>Need to be edited</th>
+ <tr>
+ <td>NODES</td>
+ <td style="text-align:left">A space delimited list of the Data Nodes that will run the C/MPI part of the pipeline. Be very careful to keep * the variable in the format ('host1' 'host2' 'host3' ...). The first node is the same node as the MLNODE.</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>UINODE</td>
+ <td style="text-align:left">The node that runs the spot-oa (aka, user interface node).</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>MLNODE</td>
+ <td style="text-align:left">The node that runs spot-ml, controlling the other nodes. The MLNODE must be the first node in the NODES list</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>GWNODE</td>
+ <td style="text-align:left">The node that runs the spot-ingest (ingest process)</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>DBNAME</td>
+ <td style="text-align:left">The name of the database used by the solution (i.e. spotdb)</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>HUSER</td>
+ <td style="text-align:left">HDFS user path that will be the base path for the solution; this is usually the same user that you created to run the solution (i.e. /user/"solution-user"</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>DSOURCES</td>
+ <td style="text-align:left">Data sources enabled in this installation</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>DFOLDERS</td>
+ <td style="text-align:left">Built-in paths for the directory structure in HDFS</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>DNS_PATH</td>
+ <td style="text-align:left">The path to the DNS records in Hive; this will be dynamically built within the pipeline with values for No ${YR}, ${MH} and ${DY}</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>PROXY_PATH</td>
+ <td style="text-align:left">The path to the proxy records in Hive; this will be dynamically built within the pipeline with values for ${YR}, ${MH} and ${DY}</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>FLOW_PATH</td>
+ <td style="text-align:left">The path to the flow records in Hive; this will be dynamically built within the pipeline with values for ${YR}, ${MH} and ${DY}</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>HPATH</td>
+ <td style="text-align:left">Path where output from the ML analysis will be stored</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>IMPALA_DEM</td>
+ <td style="text-align:left">Node where the impala demon is running, this value can be gotten from Cloudera Manager -> Impala Yes service -> Instances.</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>KRB_AUTH</td>
+ <td style="text-align:left">(default: false) Turn Kerberos authentication features on/off</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KINITPATH</td>
+ <td style="text-align:left">Path to the kinit binary file</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KINITOPTS</td>
+ <td style="text-align:left">Additional options to the kinit command</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KEYTABPATH</td>
+ <td style="text-align:left">Keytab file path</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KRB_USER</td>
+ <td style="text-align:left">Kerberos user</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>LUSER</td>
+ <td style="text-align:left">The local filesystem path for the solution, "/home/solution-user/"</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>LPATH</td>
+ <td style="text-align:left">The local path for the ML intermediate and final results, dynamically built when the pipeline runs</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>RPATH</td>
+ <td style="text-align:left">The path on the Operational Analytics node where the pipeline output will be delivered</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>LDAPATH</td>
+ <td style="text-align:left">Path to the directory containing the lda code executable and configuration files.</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>LIPATH</td>
+ <td style="text-align:left">Local ingest path</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>SPK_EXEC</td>
+ <td style="text-align:left">Number if Spark executors</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_EXEC_MEM</td>
+ <td style="text-align:left">Total memory per executor</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_DRIVER_MEM</td>
+ <td style="text-align:left">Total driver memory</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_DRIVER_MAX_RESULTS</td>
+ <td style="text-align:left">Total memory for driver max results</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_EXEC_CORES</td>
+ <td style="text-align:left">Number of cores per executor</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_DRIVER_MEM_OVERHEAD</td>
+ <td style="text-align:left">Driver memory overhead</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPRK_EXEC_MEM_OVERHEAD</td>
+ <td style="text-align:left">Executor memory overhead</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>TOL</td>
+ <td style="text-align:left">Results threshold</td>
+ <td>No</td>
+ </tr>
+ </table>
+ <br><br>
+ <b>NOTE: deprecated keys will be removed in the next releases.</b><br>
+ <b>More details about how to set up Spark properties please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/SPARKCONF.md">Spark Configuration</a></b><br><br>
+
+ <h3>3.4 Run spot-setup.</h3>
+ Copy the configuration file edited in the previous step to "/etc/" folder.<br>
+ <p class="terminal">
+ sudo cp spot.conf /etc/.
+ </p><br>
+
+ Copy the configuration to the two nodes named as UINODE and MLNODE.<br>
+ <p class="terminal">
+ sudo scp spot.conf solution_user@node:/etc/.
+ </p><br>
+
+ Run the hdfs_setup.sh script to create folders in Hadoop for the different use cases (flow, DNS or Proxy), create the Hive database, and finally execute hive query scripts that creates Hive tables needed to access netflow, DNS and proxy data.
+ <p class="terminal">
+ ./hdfs_setup.sh
+ </p><br>
+
+ </div>
+ <div id="ingest">
+ <h2>4 Ingest.</h2>
+ <h3> 4.1 Ingest Code.</h3>
+ <p>
+ Copy the ingest folder (spot-ingest) to the selected node for ingest process (i.e. edge server). If you cloned the code in the edge server and you are planning to use the same server for ingest you dont need to copy the folder.
+ </p>
+
+ <h3>4.2 Ingest dependencies.</h3>
+ <ul>
+ <li>
+ Create a src folder to install all the dependencies.<br>
+ <p class="terminal">
+ cd spot-ingest <br>
+ mkdir src <br>
+ cd src <br>
+ </p><br>
+ </li>
+ <li>
+ Install pip - python package manager.<br>
+ <p class="terminal">
+ wget --no-check-certificate https://bootstrap.pypa.io/get-pip.py <br>
+ sudo -H python get-pip.py
+ </p><br>
+ </li>
+ <li>
+ kafka-python (how to install) -- Python client for the Apache Kafka distributed stream processing system.<br>
+ <p class="terminal">
+ sudo -H pip install kafka-python
+ </p><br>
+ </li>
+ <li>
+ watchdog - (how to install) Python API library and shell utilities to monitor file system events.<br>
+ <p class="terminal">
+ sudo -H pip install watchdog
+ </p><br>
+ </li>
+ <li>
+ spot-nfdump - netflow dissector tool. This version is a custom version developed for apache spot (incubating) that has special features required for spot-ml.<br>
+ <p class="terminal">
+ sudo yum -y groupinstall "Development Tools"<br>
+ git clone https://github.com/Open-Network-Insight/spot-nfdump.git <br>
+ cd spot-nfdump<br>
+ ./install_nfdump.sh<br>
+ cd ..
+ </p><br>
+ </li>
+ <li>
+ tshark - DNS dissector tool. For tshark, follow the steps on the web site to install it. Tshark must be downloaded and built from
+ <a href="https://www.wireshark.org/download.html"> Wireshark page</a><br>
+ Full instructions for compiling Wireshark can be found <a href="https://www.wireshark.org/docs/wsug_html_chunked/ChBuildInstallUnixBuild.html">here</a> instructions for compiling<br>
+ <p class="terminal">
+ sudo yum -y install gtk2-devel gtk+-devel bison qt-devel qt5-qtbase-devel sudo yum -y groupinstall "Development Tools"<br>
+ sudo yum -y install libpcap-devel<br>
+ #compile Wireshark<br>
+ wget https://1.na.dl.wireshark.org/src/wireshark-2.2.3.tar.bz2 tar xvf wireshark-2.0.1.tar.bz2<br>
+ cd wireshark-2.0.1<br>
+ ./configure --with-gtk2 --disable-wireshark<br>
+ make<br>
+ sudo make install<br>
+ cd ..<br>
+ </p><br>
+ </li>
+ <li>
+ screen -- The screen utility is used to capture output from the ingest component for logging, troubleshooting, etc. You can check if screen is installed on the node.<br>
+ <p class="terminal">
+ which screen
+ </p><br>
+ If screen is not available, install it.
+ <p class="terminal">
+ sudo yum install screen
+ </p><br>
+ </li>
+ <li>
+ Spark-Streaming – Download the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name).
+ <b>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</b><br>
+ <p class="terminal">
+ cd spot-ingest/common<br>
+ wget https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-kafka- 0-8-assembly_2.11/2.0.0/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar
+ </p><br>
+ </li>
+ </ul>
+
+ <h3>4.3 Ingest configuration.</h3>
+ Ingest Configuration:<br>
+ The file ingest_conf.json contains all the required configuration to start the ingest module
+ <ul>
+ <li><b>dbname:</b> Name of HIVE database where all the ingested data will be stored in avro-parquet format.</li>
+ <li><b>hdfs_app_path:</b> Application path in HDFS where the pipelines will be stored (i.e /user/application_user/).</li>
+ <li><b>kafka:</b> Kafka and Zookeeper server information required to create/listen topics and partitions.</li>
+ <li><b>collector_processes:</b> Ingest framework uses multiprocessing to collect files (different from workers), this configuration key defines the numbers of collector processes to use.</li>
+ <li><b>spark-streaming:</b> Proxy pipeline uses spark streaming to ingest data, this configuration is required to setup the spark application for more details please check : how to configure spark</li>
+ <li><b>pipelines:</b> In this section you can add multiple configurations for either the same pipeline or different pipelines. The configuration name must be lowercase without spaces (i.e. flow_internals).</li>
+ <li><b>local_staging:</b> (for each pipeline) this path is very important, ingest uses this for tmp files</li>
+ </ul>
+ For more information about spot ingest please go to <a href="https://github.com/apache/incubator-spot/tree/master/spot-ingest"> spot-ingest</a><br>
+ </div>
+ <div id="ml">
+
+ <h2>5. Machine Learning.</h2>
+ <h3>5.1 ML code.</h3>
+ Copy ML code to the primary ML node, the node will launch Spark application.
+ <p class="terminal">
+ scp -r spot-ml "ml-node":/home/"solution-user"/. ssh "ml-node"
+ mv spot-ml ml
+ cd /home/"solution-user"/ml
+ </p><br>
+
+ <h3>5.1 ML dependencies</h3>
+ <ul>
+ <li>
+ Create a src folder to install all the dependencies.
+ <p class="terminal">
+ mkdir src<br>
+ cd src
+ </p><br>
+ </li>
+ <li>Install sbt -- In order to build Scala code, a SBT installation is required. Please download and install <a href="http://www.scala-sbt.org/download.html">download.</a></li>
+ <li>
+ Build Spark application.
+ <p class="terminal">
+ cd ml<br>
+ sbt assembly
+ </p><br>
+ </li>
+ </ul>
+
+ <b>NOTE: validate spot.conf is already copied to this node in the following path: /etc/spot.conf</b>
+ </div>
+ <div id="oa">
+ <h2>6. Operational Analytics.</h2>
+ <h3>6.1 OA code.</h3>
+
+ Copy spot-oa code to the OA node designed in the configuration file (UINODE).
+ <p class="terminal">
+ scp -r spot-oa "ml-node":/home/"solution-user"/. <br>
+ ssh "oa-node"<br>
+ cd /home/"solution-user"/spot-oa
+ </p><br>
+
+ <h2>6.2 OA prerequisites.</h2>
+ In order to execute this process there are a few prerequisites:
+ <ul>
+ <li>Python 2.7.</li>
+ <li>spot-ml results. Operational Analytics works and transforms Machine Learning results. The
+ implementation of Machine Learning in this project is through spot-ml. Although the Operational Analytics is prepared to read csv files and there is not a direct dependency between spot-oa and spot-ml, it's highly recommended to have these two pieces set up together. If users want to implement their own machine learning piece to detect suspicious connections they need to refer to each data type module to know more about input format and schema.</li>
+ <li><a href="https://pypi.python.org/pypi/tld/0.7.6"> TLD 0.7.6</a></li>
+ </ul>
+
+ <h3>6.3 OA (backend) installation.</h3>
+ OA installation consists of the configuration of extra modules or components and creation of a set of files. Depending on the data type that is going to be processed some components are required and other components are not. If users are planning to analyze the three data types supported (Flow, DNS and Proxy) then all components should be configured.
+ <ol>
+ <li>Add context files. Context files should go into spot-oa/context folder and they should contain network and geo localization context. For more information on context files go to spot- oa/context/
+ <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md">README.md</a><br><br></li>
+ <li>
+ Add a file ipranges.csv: Ip ranges file is used by OA when running data type Flow. It should contain a list of ip ranges and the label for the given range, example:
+ <p class="terminal">
+ 10.0.0.1,10.255.255.255,Internal
+ </p><br>
+ </li>
+ <li>
+ Add a file iploc.csv: Ip localization file used by OA when running data type Flow. Create a csv file with ip ranges in integer format and give the coordinates for each range.<br><br>
+ </li>
+ <li>
+ Add a file networkcontext_1.csv: Ip names file is used by OA when running data type DNS and Proxy. This file should contains two columns, one for Ip the other for the name, example:
+ <p class="terminal">
+ 10.192.180.150, AnyMachine <br>
+ 10.192.1.1, MySystem
+ </p><br>
+ </li>
+ <li>
+ The spot-setup project contains scripts to install the hive database and also includes the main configuration file for this tool. The main file is called spot.conf which contains different variables that the user can set up to customize their installation. Some variables must be updated in order to have spot-ml and spot-oa working.<br><br>
+ To run the OA process it's required to install spot-setup. If it's already installed just make sure the following configuration are set up in spot.conf file (oa node).<br><br>
+ <b>LUSER:</b> represents the home folder for the user in the Machine Learning node. It's used to know where to return feedback.<br>
+ <b>HUSER:</b> represents the HDFS folder. It's used to know from where to get Machine Learning results.<br>
+ <b>IMPALA_DEM:</b> represents the node running Impala daemon. It's needed to execute Impala queries in the OA process.<br>
+ <b>DBNAME:</b> Hive database, the name is required for OA to execute queries against this database. LPATH: represents the local path where the feedback is going to be sent, it actually works with LUSER.<br><br>
+ </li>
+ <li>
+ Configure components. Components are python modules included in this project that add context and details to the data being analyzed. There are five components and while not all components are required to every data type, it's recommended to configure all of them in case new data types are analyzed in the future. For more details about how to configure each component go to <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/components/READM [...]
+ </li>
+ <li>
+ You need to update the engine.json file accordingly:
+ <p class="terminal">
+ {
+ "oa_data_engine":"<database engine>",
+ "impala":{
+ "impala_daemon":"<node>"
+ },
+ "hive":{}
+ }
+ </p><br>
+ Where:
+ <ul>
+ <li>: Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the following keys, where you'll need to add the corresponding node name.<br></li>
+ <li>: The node name in your cluster where you have the database service running.</li>
+ </ul>
+ </li>
+ </ol>
+ For more information please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md"> https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md</a>
+
+ <h2>6.4 Visualization.</h2>
+ <p>
+ Apache Spot (incubating) - User Interface (aka Spot UI or UI) Provides tools for interactive visualization, noise filters, white listing, and attack heuristics.<br><br>
+ Here you will find instructions to get Spot UI up and running. For more information about Spot look here.<br><br>
+ </p>
+
+ <h2>6.5 Visualization requirements.</h2>
+ <ul>
+ <li>IPython with notebook module enabled (== 3.2.0) <a href="https://ipython.org/ipython-doc/3/index.html"> link</a></li>
+ <li>NPM - Node Package Manager <a href="https://www.npmjs.com"> link</a></li>
+ <li>spot-oa output > Spot UI takes any output from spot-oa backend, as input for the visualization tools provided. Please make sure there are files available under PATH_TO_SPOT/ui/data/${PIPELINE}/${DATE}/</li>
+ </ul>
+
+ <h2>6.6 Install visualization.</h2>
+ <ol>
+ <li>
+ Go to Spot UI folder:
+ <p class="terminal">cd spot-oa/ui</p><br>
+ </li>
+ <li>
+ With root privileges, install browserify and uglify as global commands on your system.
+ <p class="terminal">npm install –g browserify uglifyjs</p><br>
+ </li>
+ <li>
+ Install dependencies and build Spot UI.
+ <p class="terminal">npm install</p><br>
+ </li>
+ </ol>
+ </div>
+ </div>
+ <div id="userguide">
+ <h1>User Guide</h1>
+ <div id="uflow">
+ <h2>Flow</h2>
+ <div id="fsc">
+ <h3>Suspicious Connects</h3>
+ <p>
+ Access the analyst view for Suspicious Connects <b>http://"server-ip":8889/files/ui/flow/suspicious.html</b> .
+ Select the date that you want to review (defaults to current date). <br>
+ Your view should look similar to the one below:<br><br>
+ </p>
+ <img src="images/1.1sc1.jpg">
+ <p>
+ Suspicious Connects Web Page contains 4 frames with different functions and information:
+
+ <ul>
+ <li>Suspicious</li>
+ <li>Network View</li>
+ <li>Notebook</li>
+ <li>Details</li>
+ </ul>
+ </p>
+
+ <h3>The Suspicious frame</h3>
+ <p>
+ Located in the top left corner of the Suspicious Connects Web Page, this frame presents the Top 250 Suspicious Connections in a table format based on Machine Learning (ML) output. These are the columns depicted in this table:
+ <ul>
+ <li>Rank - ML output rank</li>
+ <li>Time - Time received field for Netflow record</li>
+ <li>Source IP - Netflow Record Source IP Address</li>
+ <li>Destination IP - Netflow Record Destination IP Address</li>
+ <li>Source Port - Netflow Record TCP/UDP Source Port Number</li>
+ <li>Destination Port - Netflow Record TCP/UDP Destination Port Number</li>
+ <li>Protocol - Text format for Protocol contained within Netflow Record (Ex. TCP/UDP)</li>
+ <li>Input Packets - Reported Input Packets for the Netflow Record</li>
+ <li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
+ </ul>
+ </p>
+ <p>
+ <b>Additional functionality in Suspicious frame</b>
+ <ol>
+ <li>
+ By selecting a specific row within the Suspicious frame, the connection in the Network View will be highlighted.<br><br>
+ <img src="images/1.1_sc2.jpg"><br><br>
+ </li>
+ <li>
+ In addition, by performing this row selection the Details Frame presents all the Netflow records in between Source & Destination IP Addresses that happened in the same minute as the Suspicious Record selected<br><br>
+ <img src="images/1.1_sc3.jpg"><br><br>
+ </li>
+ <li>
+ Next to a Source/Destination IP Addresses, a shield icon might be present. This icon denotes any reputation services value context added as part of the Operational Analytics component. By rolling over you can see the IP Address Reputation result<br><br>
+ <img src="images/1.1_sc4.jpg"><br><br>
+ </li>
+ <li>
+ An additional icon next to the IP addresses within the Suspicious frame is the globe icon. This icon denotes Geo-localization information context added as part of the Operational Analytics component. By rolling over you can see the additional information<br><br>
+ <img src="images/1.1_sc5.jpg"><br><br>
+ </li>
+ </ol>
+ </p>
+
+ <h3>The Network View frame</h3>
+ <p>
+ Located at the top right corner of the Suspicious Connects Web Page. It is a graphical representation of the Suspicious records relationships.
+ If context has been added, Internal IP Addresses will be presented as diamonds and External IP Addresses as circles.<br><br>
+ </p>
+ <img src="images/1.1_sc6.jpg"><br><br>
+ <p>
+ <b>Additional functionality in Network View frame</b>
+ <ol>
+ <li>
+ As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.<br><br>
+ <img src="images/1.1_sc7.jpg"><br><br>
+ </li>
+ <li>
+ A primary mouse click over one of the nodes will bring a chord diagram into the Details frame.
+ The chord diagram is a graphical representation of the connections between the selected node and other nodes within Suspicious Connects records,
+ providing number of Bytes From & To. You can move your mouse over an IP to get additional information. In addition,
+ drag the chord graph to change its orientation.<br><br>
+ <img src="images/1.1_sc8.jpg"><br><br>
+ </li>
+ <li>
+ A secondary mouse click uses the node information in order to apply an IP filter to the Suspicious Web Page.<br><br>
+ <img src="images/1.1_sc9.jpg"><br><br>
+ </li>
+ </ol>
+ </p>
+
+ <h3>The Notebook frame</h3>
+ <p>
+ This frame contains an initialized Jupyter Notebook. The main function is to allow the Analyst to score IP Addresses and Ports with different values.
+ In order to assign a risk to a specific connection, select it using a combination of all the combo boxes,
+ select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.
+ Selecting a value from each list will narrow down the coincidences, therefore if the analyst wishes to score all connections with one same relevant attribute (i.e. src port 80),
+ then select only the combo boxes that are relevant and leave the rest at the first row at the top.
+ </p>
+ <img src="images/1.1_sc10.jpg"><br><br>
+
+ <h3>The Score button</h3>
+ <p>
+ When the Analyst clicks on the Score button, the action will find all coincidences exactly matching the selected values and update their score to the rating selected in the radio button list.
+ </p>
+
+ <h3>The Save button</h3>
+ <p>
+ Analysts must use Save button in order to store the scored connections. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page, including from the lists in the notebook. This will also reorder the flow_scores.csv file to move all scored connections to the end of the file and sort the rest by severity value. A shell script will be executed to copy the fil [...]
+
+ <ul>
+ <li>LPATH</li>
+ <li>MLNODE</li>
+ <li>LUSER</li>
+ </ul>
+
+ For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.
+ </p>
+
+ <h3>The Quick IP Scoring box</h3>
+ <p>
+ This box allows the Analyst to enter an IP Address and scored using the "Score" and "Save" buttons using the same process depicted above
+ </p>
+
+ <h3>Suspicious Connects Web Page Input files</h3>
+ <ul>
+ <li>flow_scores.csv</li>
+ <li>flow_scores_bu.csv</li>
+ </ul>
+ </div>
+ <div id="fti">
+ <h3>Threat Investigation</h3>
+ <p>
+ Access the analyst view for suspicious connects <b>http://"server-ip":8889/files/ui/flow/suspicious.html.</b>
+ Select the date that you want to review. <br>
+ Your screen should now look like this:<br><br>
+ <img src="images/1.1sc1.jpg"><br><br>
+
+ The analyst must score the suspicious connections before moving into Threat Investigation View,
+ please refer to <a href="#fsc">Suspicious Connects Analyst View</a> walk-through <br>
+ Select <b>Flows > Threat Investigation </b> from apache spot (incubating) Menu.<br><br>
+ <img src="images/1.1_ti01.jpg"><br><br>
+
+ <b>Threat Investigation</b> Web Page will be opened, loading the embedded Jupyter notebook.<br><br>
+ <img src="images/1.1_ti02.jpg"><br><br>
+
+ <h3>Expanded search</h3>
+ <p>
+ You can select any IP from the list and click <b>Search</b> to view specific details about it. A query to the flow table will be executed looking into the raw data initially collected to find all communication between this and any other IP Addresses during the day, collecting additional information, such as:
+
+ <ul>
+ <li>max & avg number of bytes sent/received</li>
+ <li>max & avg number of packets sent/received</li>
+ <li>destination port</li>
+ <li>source port</li>
+ <li>first & last connection time</li>
+ <li>count of connections</li>
+ </ul>
+
+ The full output of this query is stored into the ir-<ip>.csv file. If an expanded search was previously executed on this IP, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used.<br><br>
+
+ Based on the results in this file, the following functions will be executed:<br><br>
+
+ <ul>
+ <li>get_in_out_and_twoway_conns</li>
+ <li>add_geospatial_info()</li>
+ <li>add_network_context()</li>
+ </ul>
+
+ The system will create three dictionaries, each containing:<br><br>
+ <ul>
+ <li>Inbound connections (when the suspicious IP acts only as destination)</li>
+ <li>Outbound connections (when the suspicious IP acts only as source)</li>
+ <li>2Way Connections (when the suspicious IP acts as both source and destination)</li>
+
+ </ul>
+
+ If an iploc.csv file is available, each dictionary will be updated with the geolocation data for each IP.<br>
+ If a network_context_1.txt file is available, a description for each identified node will also be added to each dictionary.<br><br>
+
+ The connections dictionary will be separated into two smaller dictionaries, each containing<br><br>
+ <ul>
+ <li>Top 'n' IP's per number of connections.</li>
+ <li>Top 'n' IP's per bytes transferred.</li>
+ <li>The number of results stored in the dictionaries (n) can be set by updating the value of the top_results variable.</li>
+ </ul>
+ </p>
+
+ <h3>Save Comments</h3>
+ <p>
+ In addition, a web form is displayed under the title of 'Threat summary',
+ where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.<br><br>
+ Click on the Save button after entering the data to write it into a CSV file, which eventually will be used in the Storyboard Analyst View.<br><br>
+ <img src="images/1.1_ti03.jpg"><br><br>
+ </p>
+
+ <p>
+ After creating the csv file with the analysis description,
+ the following functions will generate all graphs and diagrams related to the IP under investigation,
+ to populate the Storyboard Analyst view.<br><br>
+
+ <ul>
+ <li>generate_attack_map_file(anchor_ip, top_inbound_b, outbound, twoway)</li>
+ <li>generate_stats(anchor_ip, top_inbound_b, outbound, twoway, threat_name)</li>
+ <li>generate_dendro(anchor_ip, top_inbound_b, outbound, twoway, date)</li>
+ <li>details_inbound(anchor_ip,top_inbound_b)</li>
+ </ul>
+
+ <b>generate_attack_map_file()</b> - create a globe map indicating the trajectory of the connections based on their geolocation.
+ This function depends on having geolocation data for each IP. If you haven't set up a geolocation database file, the map file won't be generated.<br>
+ <b>Output:</b> globe_<ip>.json<br><br>
+
+ <b>generate_stats()</b> - This will create the horizontal bar graph for the Impact Analysis.
+ This will represent the number of inbound, outbound and twoway connections found.<br>
+ <b>Output:</b> stats-<ip>.json<br><br>
+
+ <b>generate_dendro()</b> - This function creates a file linking all different IP's that have connected to the IP under investigation,
+ this will be displayed in the Storyboard under the Incident Progression panel as a dendrogram.
+ If no network context file is included, the dendrogram will only be 1 level deep, but if a network context file is included,
+ additional levels will be added to the dendrogram to break down the threat activity.<br>
+ <b>Output:</b> dendro-<ip>.json<br><br>
+
+ <b>details_inbound()</b> - This function executes a query to the flow table, to find additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br>
+ <b>Output:</b> sbdet-<ip>.tsv<br><br>
+
+ <b>add_threat()</b> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed.
+ This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br>
+ <b>Output:</b> threats.csv<br><br>
+
+ Each function will print a message to let you know if its output file was successfully updated.<br><br>
+
+ <h3>Continue to the Storyboard</h3>
+ <p>
+ Once you have saved comments on any suspicious IP, you can continue to the Storyboard to check the results.
+
+ <b>Input files</b>
+ <ul>
+ <li>flow_scores.csv</li>
+ <li>iploc.csv</li>
+ <li>network_context_1.txt</li>
+ </ul>
+
+ <b>Output files</b>
+ <ul>
+
+ <li>/oni-oa/data/flow/<date>/threats.csv</li>
+ <li>/oni-oa/data/flow/<date>/threat_<ip>.csv</li>
+ <li>/oni-oa/data/flow/<date>/sbdet-<ip>.tsv</li>
+ <li>/oni-oa/data/flow/<date>/globe_<ip>.json</li>
+ <li>/oni-oa/data/flow/<date>/stats-<ip>.json</li>
+ <li>/oni-oa/data/flow/<date>/dendro-<ip>.json</li>
+ </ul>
+ </p>
+
+ <b>HDFS tables consumed:</b> flow
+ </p>
+ </p>
+ </div>
+ <div id="fsb">
+ <h3>Storyboard</h3>
+ <ol>
+ <li>
+ Select the option <b>Flow > Storyboard</b> from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/sb_tit1.JPG"><br><br>
+ </li>
+ <li>
+ Your view should look something like this, depending on the IP's you have analyzed on the Threat Analysis for that day.
+ You can select a different date from the calendar.<br><br>
+ <img src="images/flow_sb_1.JPG"><br><br>
+ </li>
+ <li>
+ Review the results:<br><br>
+
+ <b>Executive Threat Briefing</b><br>
+ <b>Data source file:</b> threats.csv
+ Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook.
+ You can click on any title and the additional information will be displayed.<br><br>
+ <img src="images/flow_sb_2.JPG" style="width: 50%"><br><br>
+
+ Clicking on a threat from the list will also update the additional frames.<br><br>
+
+ <b>Incident Progression</b><br>
+ <b>Data source file:</b> dendro-<ip>.json<br>
+ Frame located in the top right of the Storyboard Web page<br><br>
+ <img src="images/flow_sb_3.JPG"><br><br>
+
+ Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.
+ When network context is available, this graph will present an extra level to break down each type of connection into detailed context.<br><br>
+
+ <b>Impact Analysis</b>
+ <b>Data source file:</b> stats-<ip>.json<br><br>
+ <img src="images/flow_sb_4.JPG" style="width: 50%"><br><br>
+
+
+ Impact Analysis displays a horizontal bar graph representing the number of inbound, outbound and two-way connections found related to the threat.
+ Clicking any bar in the graph, will break down that information into its context.<br><br>
+
+ <b>Map View | Globe</b><br>
+ <b>Data source file:</b> globe_<ip>.json<br><br>
+ <img src="images/flow_sb_5.JPG" style="width: 50%"><br><br>
+
+ Map View Globe will only be created if you have a geolocation database.
+ This is intended to represent on a global scale the communication detected,
+ using the geolocation data of each IP to print lines on the map showing the flow of the data.<br><br>
+
+ <b>Timeline</b><br>
+ <b>Data source file:</b> sbdet-<ip>.json<br><br>
+ <img src="images/flow_sb_6.JPG" style="width: 50%"><br><br>
+
+ Timeline is created using the resulting connections found during the Threat Investigation process.
+ It will display 'clusters' of inbound connections to the IP, grouped by time;
+ showing an overall idea of the times during the day with the most activity.
+ You can zoom in or out into the graphs timeline using your mouse scroll.<br><br>
+
+ <b>Input files</b><br><br>
+ <ul>
+ <li>threats.csv</li>
+ <li>threat-dendro-${id}.json</li>
+ <li>stats-${id}.json</li>
+ <li>globe-${id}.json</li>
+ <li>sbdet-${id}.tsv</li>
+ </ul>
+ </li>
+ </ol>
+ </div>
+ <div id="fis">
+ <h3>Ingest Summary</h3>
+ <ol>
+ <li>
+ Load the Ingest Summary page by going to <b>http://"server-ip":8889/files/index_ingest.html </b> or using the drop down menu.<br><br>
+ <img src="images/is1.png"><br><br>
+ </li>
+ <li>
+ Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days.
+ Your view should now look like this:<br><br>
+ <img src="images/is2.png"><br><br>
+ </li>
+ <li>
+ Ingest Summary presents the Flows ingestion timeline, showing the total flows for a particular period of time.<br><br>
+ <ul>
+ <li>Analyst can zoom in/out on the graph.</li>
+ <li>Analyst can zoom in/out on the graph.</li>
+ </ul>
+ </li>
+ </ol>
+ </div>
+ </div>
+ <div id="udns">
+ <h2>DNS</h2>
+ <div id="dsc">
+ <h3>Suspicious DNS</h3>
+ <ol>
+ <li>
+ <b>Open the analyst view for Suspicious DNS:</b> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).<br>
+ Your screen should now look like this:<br><br>
+ <img src="images/1.1_dns_sc01.jpg"><br><br>
+ </li>
+ <li>
+ <b>The Suspicious <frame:></frame:></b>
+ <p>
+ Located at the top left of the Web page, this frame shows the top 250 suspicious DNS from the Machine Learning (ML) output.<br><br>
+ <ol>
+ <li>By moving the mouse over a suspicious DNS,
+ you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
+ </li>
+ <li>
+ Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
+ The icon will change its color depending upon the results from specific reputation services.<br><br>
+ </li>
+ <li>
+ By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame.
+ In addition Details frame will be populated with additional communications directed to the same DNS record.<br><br>
+ </li>
+ </ol>
+ </p>
+ </li>
+ <li>
+ <b>The Network View frame</b><br><br>
+ <p>
+ Located at the top right corner, Network View is a graphic representation of the "Suspicious DNS".<br><br>
+ <ol>
+ <li>As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br></li>
+ <li>Diamonds represents DNS records and circles represents IP addresses communicating to the respective DNS record<br><br></li>
+ <li>A primary mouse click in an IP Address (circle) will bring a diagram within Details frame, providing all the Domain Name records queried by that particular IP Address<br><br></li>
+ <li>A secondary mouse click uses the node information to filter suspicious data.<br><br></li>
+ </ol>
+ </p>
+ </li>
+ <li>
+ <b>The Details frame</b><br><br>
+ Located at the bottom right corner of the Web page. It provides additional information for the selected connection.<br><br>
+ Detail View frame has two modes:<br><br>
+ <ul>
+ <li>Table details (when you select a record in the Suspicious frame).</li>
+ <li>Dendrogram diagram (when you select an IP address in the Network View frame)<br><br></li>
+ </ul>
+ </li>
+ <li>
+ <b>The Notebook frame</b><br>
+ <p>
+ This frame contains an initialized Jupyter Notebook. The main function is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, therefor [...]
+ </p>
+ <p>
+ <b>The Score button</b><br><br>
+ Pressing the 'Score' button will find all exact matches of the selected threat (Client IP or Query) in the dns_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the dns_scores.csv file at the end of the process.<br>
+ Selecting values from both the "Client IP" and "Query" lists to score them together, will update every matching threat individually with the same rating value, but not necessarily as a Client_IP-Query pair.<br><br>
+ You can score a large set of similar or coincident queries by entering a keyword in the "Quick Scoring" text field and then select a severity value from the radiobutton list. The value entered here will only search for matches on the dns_qry_name name column. "Quick Scoring" text field has precedence over any selection made on the lists.<br>
+ </p>
+ <p>
+ <b>The Save button</b><br><br>
+ Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:
+ <ul>
+ <li>LPATH</li>
+ <li>MLNODE</li>
+ <li>LUSER</li>
+ </ul>
+ </p>
+ </li>
+ </ol>
+ <b>Input files</b>
+ <ul>
+ <li>dns_scores.csv</li>
+ <li>dns_scores_bu.csv </li>
+ </ul>
+ </div>
+ <div id="dti">
+ <h3>DNS Threat Investigation</h3>
+ Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.<br>
+ Your view should now look like this:<br><br>
+ <img src="images/1.1_dns_sc01.jpg"><br><br>
+
+ The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.<br><br>
+ Select DNS > Threat Investigation from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/1.1_dns_ti01.jpg"><br><br>
+
+ Threat Investigation Web Page will be opened, loading the embedded Jupyter notebook. A list with all IPs and DNS Names scored as High risk will be presented<br><br>
+ <img src="images/1.1_dns_ti02.png"><br><br>
+
+ <b>Expanded Search</b><br><br>
+
+ Select any value from the list and press the "Search" button. The system will execute a query to the dns table,
+ looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following criteria:<br><br>
+
+ <b>Expanded Search for a particular Domain Name</b><br>
+ The query results will provide the different unique IP Addresses list that have queried this particular Domain,
+ the list will be sorted by the quantity of connections.<br><br>
+ <img src="images/1.1_dns_ti03.jpg" style="width: 50%;"><br><br>
+
+ <b>Expanded Search for a particular IP</b><br>
+ The expanded search will provide the different unique Domains list that this particular IP queried in one day,
+ they will be sorted by the quantity of connections made to each specific Domain Name.<br><br>
+ <img src="images/1.1_dns_ti04.jpg" style="width: 50%;"><br><br>
+
+ The full output of this query is stored into the threat-dendro-<threat>.csv file, from which the top 'n' results will be extracted and displayed in a table. If an expanded search was previously executed on this IP or Domain, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used, so please monitor t [...]
+
+ <b>Save comments.</b><br>
+ In addition, a web form is displayed under the title of 'Threat summary',
+ where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.<br><br>
+ <img src="images/1.1_dns_ti05.jpg"><br><br>
+
+ Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form.
+ This file is used at the Storyboard section to display all the comments entered by the user,
+ as well it will serve as a index of the threats analyzed.<br><br>
+
+ <b>Continue to the Storyboard.</b><br>
+ Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.<br><br>
+
+ <b>Input files</b><br>
+ <ul>
+ <li>ipython/dns/user/<date>/dns_scores.css</li>
+ </ul>
+
+ <b>Output files</b>
+ <ul>
+ <li>ipython/dns/user/<date>/threats.csv</li>
+ <li>ipython/dns/user/<date>/threat-dendro-<threat>.csv</li>
+ </ul>
+
+ <b>HDFS tables consumed: </b> dns
+
+ </div>
+ <div id="dsb">
+ <h3>DNS Storyboard</h3>
+ <b>Walk-through</b><br><br>
+ <ol>
+ <li>
+ Select the option <b>DNS > Storyboard</b> from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/dns_sb_tit1.jpg"><br><br>
+ </li>
+ <li>
+ Your view should look something like this,
+ depending on how many threats you have analyzed and commented on the Threat Analysis for that day.
+ You can select a different date from the calendar.<br><br>
+ <img src="images/1.1_dns_sb01.jpg"><br><br>
+ </li>
+ </ol>
+ <p>
+ <b>Executive Threat Briefing</b><br>
+ <b>Data source file:</b> threats.csv<br>
+ Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook.
+ You can click on any title and view the additional comments at the bottom area of the panel.<br><br>
+
+ <b>Incident progression</b>
+ <b>Data source file:</b> threat-dendro-<threat>.csv<br>
+ Incident progression frame is located on the right side of the Web page.<br><br>
+ <img src="images/1.1_dns_sb02.jpg" style="width: 50%;"><br><br>
+
+ This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.<br><br>
+
+ <b>Input files</b>
+ <ul>
+ <li>threats.csv</li>
+ <li>threat-dendro-<threat>.csv</li>
+ </ul>
+ </p>
+ </div>
+ </div>
+ <div id="uproxy">
+ <h2>Proxy</h2>
+ <div id="psc">
+ <h3>Suspicious Proxy</h3>
+ <b>Walk-through</b>
+ <ol>
+ <li>
+ <b>Open the analyst view for Suspicious Proxy:</b> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>.
+ Select the date that you want to review (defaults to current date). <br>
+ Your screen should now look like this:<br><br>
+ <img src="images/1.1_proxy_sc01.jpg"><br><br>
+
+ </li>
+ <li>
+ <b>The Suspicious frame</b><br><br>
+ Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.<br><br>
+
+ <ol>
+ <li>
+ By moving the mouse over a suspicious Proxy record,
+ you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
+ </li>
+ <li>
+ The Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
+ The icon will change its color depending upon the results from the Reputation Service.<br><br>
+ </li>
+ <li>
+ The List icon. When the user mouse over this icon, it presents the Web Categories provided by the Reputation Service<br><br>
+ </li>
+ <li>
+ By selecting on a Suspicious Proxy record, you will highlight current row as well as the node from Network View frame. In addition,
+ Details frame will be populated with additional communications directed to the same Proxy record.<br><br>
+ </li>
+ </ol>
+ </li>
+ <li>
+ <b>The Network View frame</b><br><br>
+ Located at the top right corner, Network View is a hierarchical force graph used to represent the "Suspicious Proxy" connections.<br><br>
+
+ <b>Network View Force Graph Order Hierarchy</b><br><br>
+ <ul>
+ <li>Root Proxy Node</li>
+ <li>Proxy Request Method</li>
+ <li>Proxy Host</li>
+ <li>Proxy Path</li>
+ <li>Client IP Address</li>
+ </ul><br>
+ <b>Network View Functionality</b>
+ <ol>
+ <li>
+ As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br>
+ <img src="images/1.1_proxy_sc02.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ Graph can be zoomed in/out and can be moved in the frame<br><br>
+ <img src="images/1.1_proxy_sc03.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ By double-clicking in the Root Proxy Node the graph can be fully expanded/collapsed<br><br>
+ <img src="images/1.1_proxy_sc04.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ By double-clicking a node, the node can be expanded/collapsed one level<br><br>
+ <img src="images/1.1_proxy_sc05.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ The path in yellow represents the Suspicious record selected in the suspicious frame<br><br>
+ <img src="images/1.1_proxy_sc06.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ Records will be highlighted with different colors depending upon the Risk Reputation provided by the Reputation Service<br><br>
+ <img src="images/1.1_proxy_sc07.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames <br><br>
+ <img src="images/1.1_proxy_sc08.jpg" style="width: 60%;"><br><br>
+ </li>
+ </ol>
+ </li>
+ <li>
+ <b>The Details frame</b><br><br>
+ Located at the bottom right corner of the Web page. It provides additional information for the selected connection in the Suspicious frame.
+ It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type, Proxy Server IP, Bytes.<br><br>
+ <img src="images/1.1_proxy_sc09.jpg" style="width: 60%;"><br><br>
+ </li>
+ <li>
+ <b>The Notebook frame</b><br><br>
+ This frame contains an initialized Jupyter Notebook. The main function is to allow the Analyst to score Proxy records with different values. In order to assign a risk to a specific connection, select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.<br><br>
+ <img src="images/1.1_proxy_sc10.jpg" style="width: 60%;"><br><br>
+
+ </li>
+ </ol>
+
+ <b>The Score button</b><br><br>
+ Pressing the 'Score' button will find all exact matches of the selected threat (Proxy Record) in the proxy_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the proxy_scores.csv file at the end of the process.<br><br>
+
+ <b>The Save button</b><br><br>
+ Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:
+ <ul>
+ <li>LPATH</li>
+ <li>MLNODE</li>
+ <li>LUSER</li>
+ </ul>
+
+ For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.<br><br>
+
+ <b>Input files</b>
+ <ul>
+ <li>proxy_scores.csv </li>
+ <li>proxy_scores_bu.csv</li>
+ </ul>
+ </div>
+ <div id="pti">
+ <h3>Proxy Threat Investigation</h3>
+ <b>Walk-through</b><br><br>
+ Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review. <br>
+ Your view should now look like this:<br><br>
+ <img src="images/1.1_proxy_sc01.jpg"><br><br>
+
+ The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.
+ Select <b>Proxy > Threat Investigation</b> from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/1.1_proxy_ti01.jpg"><br><br>
+
+ Threat Investigation Web Page will be opened, loading the embedded Jupyter notebook. A list with all Proxy Records scored as High risk will be presented<br><br>
+ <img src="images/1.1_proxy_ti02.jpg" style="width: 60%;"><br><br>
+
+ <b>Expanded Search</b><br><br>
+
+ Select any value from the list and press the "Search" button. The system will execute a query to the proxy table,
+ looking into the raw data initially collected to find additional activity for the selected Proxy Record.
+ Results will be extracted and displayed in a table. If an expanded search was previously executed on this Proxy Record,
+ the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table.
+ Query execution time is long and will vary depending on whether Hive or Impala is being used, so please monitor the notebooks status icon for completion.
+ The quantity of results displayed on screen can be set by modifying the top_results variable,
+ additional information on how to modify this variable can be found <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/proxy/ipynb_templates/ThreatInvestigation.md"> here</a><br><br>
+ <img src="images/1.1_proxy_ti03.jpg" style="width: 60%;"><br><br>
+
+ <b>Save comments.</b><br><br>
+ In addition, a web form is displayed under the title of 'Threat summary',
+ where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.<br><br>
+ <img src="images/1.1_proxy_ti04.jpg" style="width: 60%;"><br><br>
+
+
+ Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form.
+ This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as an index of the threats analyzed.<br><br>
+
+ <b>Continue to the Storyboard.</b><br>
+ Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.<br><br>
+
+ <b>Input files</b>
+ <ul>
+ <li>proxy_scores.tsv</li>
+ </ul>
+
+ <b>Output files</b>
+ <ul>
+ <li>threats.csv</li>
+ <li>es-{id}.csv</li>
+ <li>incident-progression-{id}.json</li>
+ <li>timeline-{id}.tsv</li>
+ </ul>
+
+ <b>HDFS tables consumed:</b> proxy
+ </div>
+ <div id="psb">
+ <h3>Proxy Storyboard</h3>
+ <ol>
+ <li>
+ Select the option <b>Proxy > Storyboard</b> from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/1.1_proxy_sb01.jpg"><br><br>
+ </li>
+ <li>
+ Your view should look something like this,
+ depending on how many threats you have analyzed and commented on the Threat Analysis for that day.
+ You can select a different date from the calendar.<br><br>
+ <img src="images/1.1_proxy_sb02.jpg"><br><br>
+ </li>
+ </ol>
+
+ <b>Executive Threat Briefing</b><br><br>
+ <b>Data source file:</b> threats.csv<br>
+ Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook.
+ You can click on any title and view the additional comments at the bottom area of the panel.<br><br>
+ <img src="images/1.1_proxy_sb03.jpg" style="width: 50%;"><br><br>
+
+ <b>Incident progression</b><br><br>
+ <b>Data source file:</b> incident-progression-{id}.json<br>
+ Incident progression frame is located on the right side of the Web page.
+ Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.
+ It presents the following fields:
+ <ul>
+ <li><b>Referer</b> - URLs that refers to the Suspicious Proxy Record</li>
+ <li><b>IP</b> - All ip addresses connecting to the Suspicious Proxy Record</li>
+ <li><b>Method</b> - Proxy methods used to communicate in between the IP addresses and the Proxy Record</li>
+ <li><b>ContentType</b> - HTTP MIME Types</li>
+ <li><b>Threat</b> - Represents the Suspicious Proxy Record</li>
+ <li><b>Referred</b> - URLs that the Suspicious Proxy Record referred to</li><br>
+ <img src="images/1.1_proxy_sb04.jpg" style="width: 60%;"><br><br>
+
+ If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.<br><br>
+ <img src="images/1.1_proxy_sb06.jpg" style="width: 60%;"><br><br>
+
+ <b>Timeline</b><br>
+ <b>Data source file:</b> timeline-{id}.tsv<br>
+ Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll.
+ The number next to the IP Address represents the quantity of connections made from that particular IP to the Proxy Record in the displayed time.<br><br>
+ <img src="images/1.1_proxy_sb05.jpg" style="width: 60%;"><br><br>
+
+ <b>Input files</b><br><br>
+ <ul>
+ <li>threats.csv</li>
+ <li>incident-progression-{id}.json</li>
+ <li>timeline-{id}.tsv </li>
+ </ul>
+ </ul>
+ </div>
+ </div>
+ </div>
+ </div>
+ </div><!--end main-wrap-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/Open-Network-Insight/open-network-insight" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2017 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='js/classie.js'></script>
+ <script type='text/javascript' src='js/scripts.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
+
diff --git a/doc/js/classie.js b/doc/js/classie.js
new file mode 100755
index 0000000..f6322ed
--- /dev/null
+++ b/doc/js/classie.js
@@ -0,0 +1,70 @@
+/*!
+ * classie - class helper functions
+ * from bonzo https://github.com/ded/bonzo
+ *
+ * classie.has( elem, 'my-class' ) -> true/false
+ * classie.add( elem, 'my-new-class' )
+ * classie.remove( elem, 'my-unwanted-class' )
+ * classie.toggle( elem, 'my-class' )
+ */
+
+/*jshint browser: true, strict: true, undef: true */
+
+( function( window ) {
+
+'use strict';
+
+// class helper functions from bonzo https://github.com/ded/bonzo
+
+function classReg( className ) {
+ return new RegExp("(^|\\s+)" + className + "(\\s+|$)");
+}
+
+// classList support for class management
+// altho to be fair, the api sucks because it won't accept multiple classes at once
+var hasClass, addClass, removeClass;
+
+if ( 'classList' in document.documentElement ) {
+ hasClass = function( elem, c ) {
+ return elem.classList.contains( c );
+ };
+ addClass = function( elem, c ) {
+ elem.classList.add( c );
+ };
+ removeClass = function( elem, c ) {
+ elem.classList.remove( c );
+ };
+}
+else {
+ hasClass = function( elem, c ) {
+ return classReg( c ).test( elem.className );
+ };
+ addClass = function( elem, c ) {
+ if ( !hasClass( elem, c ) ) {
+ elem.className = elem.className + ' ' + c;
+ }
+ };
+ removeClass = function( elem, c ) {
+ elem.className = elem.className.replace( classReg( c ), ' ' );
+ };
+}
+
+function toggleClass( elem, c ) {
+ var fn = hasClass( elem, c ) ? removeClass : addClass;
+ fn( elem, c );
+}
+
+window.classie = {
+ // full names
+ hasClass: hasClass,
+ addClass: addClass,
+ removeClass: removeClass,
+ toggleClass: toggleClass,
+ // short names
+ has: hasClass,
+ add: addClass,
+ remove: removeClass,
+ toggle: toggleClass
+};
+
+})( window );
\ No newline at end of file
diff --git a/doc/js/jquery-migrate.min.js b/doc/js/jquery-migrate.min.js
new file mode 100755
index 0000000..2e84fcb
--- /dev/null
+++ b/doc/js/jquery-migrate.min.js
@@ -0,0 +1,2 @@
+/*! jQuery Migrate v1.4.1 | (c) jQuery Foundation and other contributors | jquery.org/license */
+"undefined"==typeof jQuery.migrateMute&&(jQuery.migrateMute=!0),function(a,b,c){function d(c){var d=b.console;f[c]||(f[c]=!0,a.migrateWarnings.push(c),d&&d.warn&&!a.migrateMute&&(d.warn("JQMIGRATE: "+c),a.migrateTrace&&d.trace&&d.trace()))}function e(b,c,e,f){if(Object.defineProperty)try{return void Object.defineProperty(b,c,{configurable:!0,enumerable:!0,get:function(){return d(f),e},set:function(a){d(f),e=a}})}catch(g){}a._definePropertyBroken=!0,b[c]=e}a.migrateVersion="1.4.1";var f={ [...]
\ No newline at end of file
diff --git a/doc/js/jquery.meanmenu.js b/doc/js/jquery.meanmenu.js
new file mode 100755
index 0000000..873d459
--- /dev/null
+++ b/doc/js/jquery.meanmenu.js
@@ -0,0 +1,285 @@
+/*!
+* jQuery meanMenu v2.0.8
+* @Copyright (C) 2012-2014 Chris Wharton @ MeanThemes (https://github.com/meanthemes/meanMenu)
+*
+*/
+/*
+* This program is free software: you can redistribute it and/or modify
+* it under the terms of the GNU General Public License as published by
+* the Free Software Foundation, either version 3 of the License, or
+* (at your option) any later version.
+*
+* THIS SOFTWARE AND DOCUMENTATION IS PROVIDED "AS IS," AND COPYRIGHT
+* HOLDERS MAKE NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR IMPLIED,
+* INCLUDING BUT NOT LIMITED TO, WARRANTIES OF MERCHANTABILITY OR
+* FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE OF THE SOFTWARE
+* OR DOCUMENTATION WILL NOT INFRINGE ANY THIRD PARTY PATENTS,
+* COPYRIGHTS, TRADEMARKS OR OTHER RIGHTS.COPYRIGHT HOLDERS WILL NOT
+* BE LIABLE FOR ANY DIRECT, INDIRECT, SPECIAL OR CONSEQUENTIAL
+* DAMAGES ARISING OUT OF ANY USE OF THE SOFTWARE OR DOCUMENTATION.
+*
+* You should have received a copy of the GNU General Public License
+* along with this program. If not, see <http://gnu.org/licenses/>.
+*
+* Find more information at http://www.meanthemes.com/plugins/meanmenu/
+*
+*/
+(function ($) {
+ "use strict";
+ $.fn.meanmenu = function (options) {
+ var defaults = {
+ meanMenuTarget: jQuery(this), // Target the current HTML markup you wish to replace
+ meanMenuContainer: '#mobile-nav', // Choose where meanmenu will be placed within the HTML
+ meanMenuClose: "X", // single character you want to represent the close menu button
+ meanMenuCloseSize: "18px", // set font size of close button
+ meanMenuOpen: "<span /><span /><span />", // text/markup you want when menu is closed
+ meanRevealPosition: "right", // left right or center positions
+ meanRevealPositionDistance: "0", // Tweak the position of the menu
+ meanRevealColour: "", // override CSS colours for the reveal background
+ meanScreenWidth: "1030", // set the screen width you want meanmenu to kick in at
+ meanNavPush: "", // set a height here in px, em or % if you want to budge your layout now the navigation is missing.
+ meanShowChildren: true, // true to show children in the menu, false to hide them
+ meanExpandableChildren: true, // true to allow expand/collapse children
+ meanExpand: "+", // single character you want to represent the expand for ULs
+ meanContract: "-", // single character you want to represent the contract for ULs
+ meanRemoveAttrs: false, // true to remove classes and IDs, false to keep them
+ onePage: false, // set to true for one page sites
+ meanDisplay: "block", // override display method for table cell based layouts e.g. table-cell
+ removeElements: "" // set to hide page elements
+ };
+ options = $.extend(defaults, options);
+
+ // get browser width
+ var currentWidth = window.innerWidth || document.documentElement.clientWidth;
+
+ return this.each(function () {
+ var meanMenu = options.meanMenuTarget;
+ var meanContainer = options.meanMenuContainer;
+ var meanMenuClose = options.meanMenuClose;
+ var meanMenuCloseSize = options.meanMenuCloseSize;
+ var meanMenuOpen = options.meanMenuOpen;
+ var meanRevealPosition = options.meanRevealPosition;
+ var meanRevealPositionDistance = options.meanRevealPositionDistance;
+ var meanRevealColour = options.meanRevealColour;
+ var meanScreenWidth = options.meanScreenWidth;
+ var meanNavPush = options.meanNavPush;
+ var meanRevealClass = ".meanmenu-reveal";
+ var meanShowChildren = options.meanShowChildren;
+ var meanExpandableChildren = options.meanExpandableChildren;
+ var meanExpand = options.meanExpand;
+ var meanContract = options.meanContract;
+ var meanRemoveAttrs = options.meanRemoveAttrs;
+ var onePage = options.onePage;
+ var meanDisplay = options.meanDisplay;
+ var removeElements = options.removeElements;
+
+ //detect known mobile/tablet usage
+ var isMobile = false;
+ if ( (navigator.userAgent.match(/iPhone/i)) || (navigator.userAgent.match(/iPod/i)) || (navigator.userAgent.match(/iPad/i)) || (navigator.userAgent.match(/Android/i)) || (navigator.userAgent.match(/Blackberry/i)) || (navigator.userAgent.match(/Windows Phone/i)) ) {
+ isMobile = true;
+ }
+
+ if ( (navigator.userAgent.match(/MSIE 8/i)) || (navigator.userAgent.match(/MSIE 7/i)) ) {
+ // add scrollbar for IE7 & 8 to stop breaking resize function on small content sites
+ jQuery('html').css("overflow-y" , "scroll");
+ }
+
+ var meanRevealPos = "";
+ var meanCentered = function() {
+ if (meanRevealPosition === "center") {
+ var newWidth = window.innerWidth || document.documentElement.clientWidth;
+ var meanCenter = ( (newWidth/2)-22 )+"px";
+ meanRevealPos = "left:" + meanCenter + ";right:auto;";
+
+ if (!isMobile) {
+ jQuery('.meanmenu-reveal').css("left",meanCenter);
+ } else {
+ jQuery('.meanmenu-reveal').animate({
+ left: meanCenter
+ });
+ }
+ }
+ };
+
+ var menuOn = false;
+ var meanMenuExist = false;
+
+
+ if (meanRevealPosition === "right") {
+ meanRevealPos = "right:" + meanRevealPositionDistance + ";left:auto;";
+ }
+ if (meanRevealPosition === "left") {
+ meanRevealPos = "left:" + meanRevealPositionDistance + ";right:auto;";
+ }
+ // run center function
+ meanCentered();
+
+ // set all styles for mean-reveal
+ var $navreveal = "";
+
+ var meanInner = function() {
+ // get last class name
+ if (jQuery($navreveal).is(".meanmenu-reveal.meanclose")) {
+ $navreveal.html(meanMenuClose);
+ } else {
+ $navreveal.html(meanMenuOpen);
+ }
+ };
+
+ // re-instate original nav (and call this on window.width functions)
+ var meanOriginal = function() {
+ jQuery('.mean-bar,.mean-push').remove();
+ jQuery(meanContainer).removeClass("mean-container");
+ jQuery(meanMenu).css('display', meanDisplay);
+ menuOn = false;
+ meanMenuExist = false;
+ jQuery(removeElements).removeClass('mean-remove');
+ };
+
+ // navigation reveal
+ var showMeanMenu = function() {
+ var meanStyles = "background:"+meanRevealColour+";color:"+meanRevealColour+";"+meanRevealPos;
+ if (currentWidth <= meanScreenWidth) {
+ jQuery(removeElements).addClass('mean-remove');
+ meanMenuExist = true;
+ // add class to body so we don't need to worry about media queries here, all CSS is wrapped in '.mean-container'
+ jQuery(meanContainer).addClass("mean-container");
+ jQuery('.mean-container').prepend('<div class="mean-bar"><a href="#nav" class="meanmenu-reveal" style="'+meanStyles+'">Show Navigation</a><nav class="mean-nav"></nav></div>');
+
+ //push meanMenu navigation into .mean-nav
+ var meanMenuContents = jQuery(meanMenu).html();
+ jQuery('.mean-nav').html(meanMenuContents);
+
+ // remove all classes from EVERYTHING inside meanmenu nav
+ if(meanRemoveAttrs) {
+ jQuery('nav.mean-nav ul, nav.mean-nav ul *').each(function() {
+ // First check if this has mean-remove class
+ if (jQuery(this).is('.mean-remove')) {
+ jQuery(this).attr('class', 'mean-remove');
+ } else {
+ jQuery(this).removeAttr("class");
+ }
+ jQuery(this).removeAttr("id");
+ });
+ }
+
+ // push in a holder div (this can be used if removal of nav is causing layout issues)
+ jQuery(meanMenu).before('<div class="mean-push" />');
+ jQuery('.mean-push').css("margin-top",meanNavPush);
+
+ // hide current navigation and reveal mean nav link
+ jQuery(meanMenu).hide();
+ jQuery(".meanmenu-reveal").show();
+
+ // turn 'X' on or off
+ jQuery(meanRevealClass).html(meanMenuOpen);
+ $navreveal = jQuery(meanRevealClass);
+
+ //hide mean-nav ul
+ jQuery('.mean-nav ul').hide();
+
+ // hide sub nav
+ if(meanShowChildren) {
+ // allow expandable sub nav(s)
+ if(meanExpandableChildren){
+ jQuery('.mean-nav ul ul').each(function() {
+ if(jQuery(this).children().length){
+ jQuery(this,'li:first').parent().append('<a class="mean-expand" href="#" style="font-size: '+ meanMenuCloseSize +'">'+ meanExpand +'</a>');
+ }
+ });
+ jQuery('.mean-expand').on("click",function(e){
+ e.preventDefault();
+ if (jQuery(this).hasClass("mean-clicked")) {
+ jQuery(this).text(meanExpand);
+ jQuery(this).prev('ul').slideUp(300, function(){});
+ } else {
+ jQuery(this).text(meanContract);
+ jQuery(this).prev('ul').slideDown(300, function(){});
+ }
+ jQuery(this).toggleClass("mean-clicked");
+ });
+ } else {
+ jQuery('.mean-nav ul ul').show();
+ }
+ } else {
+ jQuery('.mean-nav ul ul').hide();
+ }
+
+ // add last class to tidy up borders
+ jQuery('.mean-nav ul li').last().addClass('mean-last');
+ $navreveal.removeClass("meanclose");
+ jQuery($navreveal).click(function(e){
+ e.preventDefault();
+ if( menuOn === false ) {
+ $navreveal.css("text-align", "center");
+ $navreveal.css("text-indent", "0");
+ $navreveal.css("font-size", meanMenuCloseSize);
+ jQuery('.mean-nav ul:first').slideDown();
+ menuOn = true;
+ } else {
+ jQuery('.mean-nav ul:first').slideUp();
+ menuOn = false;
+ }
+ $navreveal.toggleClass("meanclose");
+ meanInner();
+ jQuery(removeElements).addClass('mean-remove');
+ });
+
+ // for one page websites, reset all variables...
+ if ( onePage ) {
+ jQuery('.mean-nav ul > li > a:first-child').on( "click" , function () {
+ jQuery('.mean-nav ul:first').slideUp();
+ menuOn = false;
+ jQuery($navreveal).toggleClass("meanclose").html(meanMenuOpen);
+ });
+ }
+ } else {
+ meanOriginal();
+ }
+ };
+
+ if (!isMobile) {
+ // reset menu on resize above meanScreenWidth
+ jQuery(window).resize(function () {
+ currentWidth = window.innerWidth || document.documentElement.clientWidth;
+ if (currentWidth > meanScreenWidth) {
+ meanOriginal();
+ } else {
+ meanOriginal();
+ }
+ if (currentWidth <= meanScreenWidth) {
+ showMeanMenu();
+ meanCentered();
+ } else {
+ meanOriginal();
+ }
+ });
+ }
+
+ jQuery(window).resize(function () {
+ // get browser width
+ currentWidth = window.innerWidth || document.documentElement.clientWidth;
+
+ if (!isMobile) {
+ meanOriginal();
+ if (currentWidth <= meanScreenWidth) {
+ showMeanMenu();
+ meanCentered();
+ }
+ } else {
+ meanCentered();
+ if (currentWidth <= meanScreenWidth) {
+ if (meanMenuExist === false) {
+ showMeanMenu();
+ }
+ } else {
+ meanOriginal();
+ }
+ }
+ });
+
+ // run main menuMenu function on load
+ showMeanMenu();
+ });
+ };
+})(jQuery);
diff --git a/doc/js/libs/modernizr.custom.min.js b/doc/js/libs/modernizr.custom.min.js
new file mode 100755
index 0000000..89bb6c1
--- /dev/null
+++ b/doc/js/libs/modernizr.custom.min.js
@@ -0,0 +1,4 @@
+/* Modernizr 2.6.2 (Custom Build) | MIT & BSD
+ * Build: http://modernizr.com/download/#-fontface-backgroundsize-borderimage-flexbox-hsla-multiplebgs-opacity-rgba-textshadow-cssanimations-csscolumns-generatedcontent-cssgradients-cssreflections-csstransforms-csstransforms3d-csstransitions-applicationcache-hashchange-history-audio-video-input-inputtypes-localstorage-websockets-geolocation-svg-svgclippaths-touch-webgl-shiv-mq-cssclasses-addtest-prefixed-teststyles-testprop-testallprops-hasevent-prefixes-domprefixes-css_mediaqueries-css_ [...]
+ */
+;window.Modernizr=function(a,b,c){function D(a){j.cssText=a}function E(a,b){return D(n.join(a+";")+(b||""))}function F(a,b){return typeof a===b}function G(a,b){return!!~(""+a).indexOf(b)}function H(a,b){for(var d in a){var e=a[d];if(!G(e,"-")&&j[e]!==c)return b=="pfx"?e:!0}return!1}function I(a,b,d){for(var e in a){var f=b[a[e]];if(f!==c)return d===!1?a[e]:F(f,"function")?f.bind(d||b):f}return!1}function J(a,b,c){var d=a.charAt(0).toUpperCase()+a.slice(1),e=(a+" "+p.join(d+" ")+d).split( [...]
\ No newline at end of file
diff --git a/doc/js/scripts.js b/doc/js/scripts.js
new file mode 100755
index 0000000..5c0ee88
--- /dev/null
+++ b/doc/js/scripts.js
@@ -0,0 +1,176 @@
+/*
+ * Bones Scripts File
+ * Author: Eddie Machado
+ *
+ * This file should contain any js scripts you want to add to the site.
+ * Instead of calling it in the header or throwing it inside wp_head()
+ * this file will be called automatically in the footer so as not to
+ * slow the page load.
+ *
+ * There are a lot of example functions and tools in here. If you don't
+ * need any of it, just remove it. They are meant to be helpers and are
+ * not required. It's your world baby, you can do whatever you want.
+*/
+
+
+/*
+ * Get Viewport Dimensions
+ * returns object with viewport dimensions to match css in width and height properties
+ * ( source: http://andylangton.co.uk/blog/development/get-viewport-size-width-and-height-javascript )
+*/
+function updateViewportDimensions() {
+ var w=window,d=document,e=d.documentElement,g=d.getElementsByTagName('body')[0],x=w.innerWidth||e.clientWidth||g.clientWidth,y=w.innerHeight||e.clientHeight||g.clientHeight;
+ return { width:x,height:y };
+}
+// setting the viewport width
+var viewport = updateViewportDimensions();
+
+
+/*
+ * Throttle Resize-triggered Events
+ * Wrap your actions in this function to throttle the frequency of firing them off, for better performance, esp. on mobile.
+ * ( source: http://stackoverflow.com/questions/2854407/javascript-jquery-window-resize-how-to-fire-after-the-resize-is-completed )
+*/
+var waitForFinalEvent = (function () {
+ var timers = {};
+ return function (callback, ms, uniqueId) {
+ if (!uniqueId) { uniqueId = "Don't call this twice without a uniqueId"; }
+ if (timers[uniqueId]) { clearTimeout (timers[uniqueId]); }
+ timers[uniqueId] = setTimeout(callback, ms);
+ };
+})();
+
+// how long to wait before deciding the resize has stopped, in ms. Around 50-100 should work ok.
+var timeToWaitForLast = 100;
+
+
+/*
+ * Here's an example so you can see how we're using the above function
+ *
+ * This is commented out so it won't work, but you can copy it and
+ * remove the comments.
+ *
+ *
+ *
+ * If we want to only do it on a certain page, we can setup checks so we do it
+ * as efficient as possible.
+ *
+ * if( typeof is_home === "undefined" ) var is_home = $('body').hasClass('home');
+ *
+ * This once checks to see if you're on the home page based on the body class
+ * We can then use that check to perform actions on the home page only
+ *
+ * When the window is resized, we perform this function
+ * $(window).resize(function () {
+ *
+ * // if we're on the home page, we wait the set amount (in function above) then fire the function
+ * if( is_home ) { waitForFinalEvent( function() {
+ *
+ * // update the viewport, in case the window size has changed
+ * viewport = updateViewportDimensions();
+ *
+ * // if we're above or equal to 768 fire this off
+ * if( viewport.width >= 768 ) {
+ * console.log('On home page and window sized to 768 width or more.');
+ * } else {
+ * // otherwise, let's do this instead
+ * console.log('Not on home page, or window sized to less than 768.');
+ * }
+ *
+ * }, timeToWaitForLast, "your-function-identifier-string"); }
+ * });
+ *
+ * Pretty cool huh? You can create functions like this to conditionally load
+ * content and other stuff dependent on the viewport.
+ * Remember that mobile devices and javascript aren't the best of friends.
+ * Keep it light and always make sure the larger viewports are doing the heavy lifting.
+ *
+*/
+
+/*
+ * We're going to swap out the gravatars.
+ * In the functions.php file, you can see we're not loading the gravatar
+ * images on mobile to save bandwidth. Once we hit an acceptable viewport
+ * then we can swap out those images since they are located in a data attribute.
+*/
+function loadGravatars() {
+ // set the viewport using the function above
+ viewport = updateViewportDimensions();
+ // if the viewport is tablet or larger, we load in the gravatars
+ if (viewport.width >= 768) {
+ jQuery('.comment img[data-gravatar]').each(function(){
+ jQuery(this).attr('src',jQuery(this).attr('data-gravatar'));
+ });
+ }
+} // end function
+
+
+/*
+ * Put all your regular jQuery in here.
+*/
+jQuery(document).ready(function($) {
+ jQuery('header nav').meanmenu();
+
+ // browser window scroll (in pixels) after which the "back to top" link is shown
+ var offset = 300,
+ //browser window scroll (in pixels) after which the "back to top" link opacity is reduced
+ offset_opacity = 1200,
+ //duration of the top scrolling animation (in ms)
+ scroll_top_duration = 700,
+ //grab the "back to top" link
+ $back_to_top = $('.cd-top');
+
+ //hide or show the "back to top" link
+ $(window).scroll(function(){
+ ( $(this).scrollTop() > offset ) ? $back_to_top.addClass('cd-is-visible') : $back_to_top.removeClass('cd-is-visible cd-fade-out');
+ if( $(this).scrollTop() > offset_opacity ) {
+ $back_to_top.addClass('cd-fade-out');
+ }
+ });
+
+ //smooth scroll to top
+ $back_to_top.on('click', function(event){
+ event.preventDefault();
+ $('body,html').animate({
+ scrollTop: 0 ,
+ }, scroll_top_duration
+ );
+ });
+
+ var menuLeft = document.getElementById( 'cbp-spmenu-s1' ),
+ showLeft = document.getElementById( 'showLeft' )
+ body = document.body;
+
+ showLeft.onclick = function() {
+ classie.toggle( this, 'active' );
+ classie.toggle( menuLeft, 'cbp-spmenu-open' );
+ disableOther( 'showLeft' );
+ };
+
+ function disableOther( button ) {
+ if( button !== 'showLeft' ) {
+ classie.toggle( showLeft, 'disabled' );
+ }
+ };
+
+ $(function() {
+ $('a[href*="#"]:not([href="#"])').click(function() {
+ if (location.pathname.replace(/^\//,'') == this.pathname.replace(/^\//,'') && location.hostname == this.hostname) {
+ var target = $(this.hash);
+ target = target.length ? target : $('[name=' + this.hash.slice(1) +']');
+ if (target.length) {
+ $('html, body').animate({
+ scrollTop: target.offset().top
+ }, 1000);
+ return false;
+ }
+ }
+ });
+ });
+
+ $('.cbp-spmenu a').on('click', function(){
+ $(".cbp-spmenu").removeClass("cbp-spmenu-open");
+ });
+
+
+}); /* end of as page load scripts */
diff --git a/doc/spot.css b/doc/spot.css
new file mode 100755
index 0000000..7a5fb83
--- /dev/null
+++ b/doc/spot.css
@@ -0,0 +1,81 @@
+
+img{
+ width: 95%;
+}
+
+p.terminal
+{
+ border-radius: 25px;
+ border: 2px solid #000000;
+ background: #000000;
+ color: #FFFFFF;
+ padding: 20px;
+ margin-left: 50px;
+ margin-right: 100px;
+}
+
+table.configuration
+{
+ width: 90%;
+ margin-left: 20px;
+ margin-right: 20px;
+}
+
+table.configuration th
+{
+ background-color: #212F3C;
+ color: white;
+}
+
+table.configuration td
+{
+ text-align: center;
+ padding: 8px;
+}
+
+table.configuration tr:nth-child(even){background-color: #f2f2f2}
+
+
+.sidenav {
+ height: 100%;
+ width: 200px;
+ position: fixed;
+ z-index: 1;
+ top: 0;
+ left: 0;
+ background-color: #212F3C;
+ overflow-x: hidden;
+ padding-top: 60px;
+ transition: 0.5s;
+}
+
+
+.sidenav a{
+ padding: 8px 8px 8px 32px;
+ text-decoration: none;
+ font-size: 20px;
+ color: #818181;
+ display: block;
+ transition: 0.3s
+}
+
+.sidenav li {
+ color: #818181 ;
+}
+.sidenav a:hover, .offcanvas a:focus{
+ color: #f1f1f1;
+}
+
+.sidenav .closebtn {
+ position: absolute;
+ top: 0;
+ right: 25px;
+ font-size: 36px;
+ margin-left: 50px;
+}
+
+#main {
+ transition: margin-left .5s;
+ margin-left: 200px;
+ padding: 20px;
+}
\ No newline at end of file
diff --git a/favicon.png b/favicon.png
new file mode 100755
index 0000000..1e360dd
Binary files /dev/null and b/favicon.png differ
diff --git a/includes/config.php b/includes/config.php
new file mode 100755
index 0000000..ffd994d
--- /dev/null
+++ b/includes/config.php
@@ -0,0 +1,7 @@
+<?php
+
+define('BASE_URL', 'http://spot.incubator.apache.org');
+
+//define('ROOT_PATH', $_SERVER['DOCUMENT_ROOT'] . '/apache-spot/' );
+
+?>
\ No newline at end of file
diff --git a/includes/download-sidebar.php b/includes/download-sidebar.php
new file mode 100755
index 0000000..7679c2b
--- /dev/null
+++ b/includes/download-sidebar.php
@@ -0,0 +1,14 @@
+ <div class="m-all t-all d-1of3 downloads">
+ <h1>Downloads</h1>
+ <ul>
+ <li><a href="#">Lorem Ipsum Dolor SIT AMET <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Consectetur adipisicing elit sed <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Ut enim ad minim veniam <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Lorem Ipsum Dolor SIT AMET <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Consectetur adipisicing elit sed <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Ut enim ad minim veniam <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Lorem Ipsum Dolor SIT AMET <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Consectetur adipisicing elit sed <span class="icon-keyboard_arrow_right"></span></a></li>
+ <li><a href="#">Ut enim ad minim veniam <span class="icon-keyboard_arrow_right"></span></a></li>
+ </ul>
+ </div>
\ No newline at end of file
diff --git a/includes/footer.php b/includes/footer.php
new file mode 100755
index 0000000..b0aafe2
--- /dev/null
+++ b/includes/footer.php
@@ -0,0 +1,22 @@
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='<?php echo BASE_URL; ?>/library/js/scripts.js'></script>
+ <!--<script type='text/javascript' src='wp-includes/js/wp-embed.min.js'></script>-->
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
\ No newline at end of file
diff --git a/includes/header.php b/includes/header.php
new file mode 100755
index 0000000..16e8062
--- /dev/null
+++ b/includes/header.php
@@ -0,0 +1,116 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>
+ <?php if (isset($pageTitle)) {
+ echo $pageTitle;
+ } else {
+ echo "Apache Spot";
+ } ?>
+ </title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="<?php echo BASE_URL; ?>/library/images/apple-touch-icon.png">
+ <link rel="icon" href="<?php echo BASE_URL; ?>/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="<?php echo BASE_URL; ?>/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="<?php echo BASE_URL; ?>/feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='<?php echo BASE_URL; ?>/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='<?php echo BASE_URL; ?>/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='<?php echo BASE_URL; ?>/library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='<?php echo BASE_URL; ?>/library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='<?php echo BASE_URL; ?>/library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="<?php if (isset($bodyclass)) {
+ echo $bodyclass;
+ } else {
+ echo "page";
+ } ?>" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"</a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="<?php echo BASE_URL; ?>" rel="nofollow"><img src="<?php echo BASE_URL; ?>/library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 <?php if($currentPage =='contribute'){echo 'active';}?>">
+ <a target="_blank" href="<?php echo BASE_URL; ?>/contribute" target="_blank">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="<?php echo BASE_URL; ?>/doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children <?php if( in_array($currentPage, array('project-components','visualizations','machine-learning','open-data-models','ingestion'), true )) {echo 'active';}?>">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li class="<?php if($currentPage =='open-data-models'){echo 'active';}?>"><a href="<?php echo BASE_URL; ?>/project-components/open-data-models">Open Data Models</a></li>
+ <li class="<?php if($currentPage =='ingestion'){echo 'active';}?>"><a href="<?php echo BASE_URL; ?>/project-components/ingestion">Ingestion</a></li>
+ <li class="<?php if($currentPage =='machine-learning'){echo 'active';}?>"><a href="<?php echo BASE_URL; ?>/project-components/machine-learning">Machine Learning</a></li>
+ <li class="<?php if($currentPage =='visualization'){echo 'active';}?>"><a href="<?php echo BASE_URL; ?>/project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 <?php if($currentPage =='blog'){echo 'active';}?>">
+ <a href="<?php echo BASE_URL; ?>/blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
\ No newline at end of file
diff --git a/includes/prefooter.php b/includes/prefooter.php
new file mode 100755
index 0000000..6642553
--- /dev/null
+++ b/includes/prefooter.php
@@ -0,0 +1,22 @@
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="<?php echo BASE_URL; ?>/library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="<?php echo BASE_URL; ?>/library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
\ No newline at end of file
diff --git a/includes/sidebar.php b/includes/sidebar.php
new file mode 100755
index 0000000..ff2a2b8
--- /dev/null
+++ b/includes/sidebar.php
@@ -0,0 +1,41 @@
+<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="<?php echo BASE_URL; ?>/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="<?php echo BASE_URL; ?>/blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="<?php echo BASE_URL; ?>/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="<?php echo BASE_URL; ?>/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="<?php echo BASE_URL; ?>/blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='<?php echo BASE_URL; ?>/2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='<?php echo BASE_URL; ?>/2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='<?php echo BASE_URL; ?>/2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='<?php echo BASE_URL; ?>/2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+</div>
\ No newline at end of file
diff --git a/index.php b/index.php
new file mode 100755
index 0000000..2c20ba8
--- /dev/null
+++ b/index.php
@@ -0,0 +1,283 @@
+<?php include 'includes/config.php'; ?>
+
+<?php
+$bodyclass = "home";
+$pageTitle = "Apache Spot";
+$description = "";
+$currentPage = 'home';
+?>
+<?php include 'includes/header.php'; ?>
+
+
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all t-1of2 d-1of2">
+ <h1>Apache Spot (Incubating)</h1>
+ <h1 class="thin">A Community Approach to Fighting Cyber Threats</h1>
+ </div>
+ <div class="m-all t-1of2 d-1of2 contribute">
+ <h3>Help Spot expand his hunting ground to see deeper into the darkness of cyber threats.</h3>
+ <p class="btn-margin"><a href="<?php echo BASE_URL; ?>/contribute" class="y-btn">Become a Contributor</a></p>
+ </div>
+ </div>
+ </div>
+
+ <div id="at-a-glance">
+ <div class="wrap cf">
+ <h1>Apache Spot at a Glance</h1>
+ <p>Apache Spot is a community-driven cybersecurity project, built from the ground up, to bring advanced analytics to all IT Telemetry data on an open, scalable platform. Spot expedites threat detection, investigation, and remediation via machine learning and consolidates all enterprise security data into a comprehensive IT telemetry hub based on open data models. Spot’s scalability and machine learning capabilities support an ecosystem of ML-based applications that can run [...]
+ </div>
+ </div>
+
+ <div id="content">
+ <div id="inner-content" class="wrap cf">
+ <main id="main" class="m-all t-all d-all cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+ <h1 class="center">Apache Spot Advantages</h1>
+ <p style="text-align: center;"><img src="library/images/advantages-1.png" alt="advantages" width="958" height="433" class="aligncenter size-full" />
+ </p>
+ </main>
+ </div>
+ </div>
+
+ <div id="and">
+ <div class="wrap cf">
+ <div class="and-row">
+ <div class="and-cell">
+ <img src="library/images/and.png" alt="" />
+ </div>
+ <div class="and-cell">
+ <p>
+ Apache Spot is functional after just one day and just keeps improving through feedback and machine learning.
+ </p>
+ </div>
+ </div>
+ </div>
+ </div>
+
+ <div id="how-it-works">
+ <div class="wrap cf">
+ <div class="m-all t-1of3 d-1of3">
+ <h1>How It Works</h1>
+ <p>
+ Apache Spot uses machine learning as a filter for separating bad traffic from benign and to characterize the unique behavior of network traffic. A proven process, of context enrichment, noise filtering, whitelisting and heuristics, is also applied to network data to produce a shortlist of most likely security threats.
+ </p>
+ <p class="btn-margin">
+ <a href="https://github.com/apache/incubator-spot" class="y-btn">More Info</a>
+ </p>
+ </div>
+ <div class="m-all t-2of3 d-2of3">
+ <img src="library/images/how-it-works.png" alt="" />
+ </div>
+ </div>
+ </div>
+
+ <div id="key-features">
+ <div class="wrap cf">
+ <h1>Key Features</h1>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/magnify-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Suspicious DNS packets</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Apache Spot is capable of performing deep-packet inspection of DNS traffic to build a profile of probable and improbable DNS payloads. After visualizing, normalizing, and conducting pattern searches, the analyst has a shortlist of the most likely threats present in DNS traffic.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/threat-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Threat Incident and Response</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Given an IP address, Apache Spot gathers all the characteristics about the communication associated with it – the “social network” of that IP address. Then Apache Spot builds a timeline of the conversations that originated with that IP.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/connects.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Suspicious Connects</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Apache Spot uses advanced machine learning to build a model of the machines on the network and their communication patterns. The connections between the machines that are the lowest probability are then visualized, filtered for noise, and searched for known patterns. The result is the most likely threat patterns in the data, a few hundred flows picked from billions.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/storyboard-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Storyboard</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ After an analyst has investigated a threat, the need still exists to communicate the event up and across the organization. A “dashboard” gives quick answers to the questions you already know to ask. What the analyst requires is a “storyboard,” something that tells who, what, where, and how of the story in words and interactive visualizations.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/SPOT_OpenDataModel-Icon_v1.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Open Data Models</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Spot provides common open data model for network, endpoint, and user – Open Data Models. These Open Data Models provide a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/SPOT_Collabration-Icon_v2.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Collaboration</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Spot’s Open Data Models help organizations quickly share new analytics with one another as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
+ </p>
+ </div>
+
+ <div class="cf"></div>
+ <p class="btn-margin">
+ <a href="https://github.com/apache/incubator-spot" class="y-btn">More Info</a>
+ </p>
+ </div>
+ </div>
+
+ <div id="open-data-models">
+ <div class="wrap cf">
+ <h1 class="center">Apache Spot Open Data Models (ODM)</h1>
+ <div class="m-all t-1of2 d-1of2 center">
+ <img src="library/images/odm.png" alt="Apache Spot Open Data Models">
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <p>The primary use case initially supported by Spot includes Network Traffic Analysis for network flows (Netflow, sflow, etc.), DNS and Proxy. The Spot open data model strategy aims to extend Spot capabilities to support a broader set of cybersecurity use cases.</p>
+ <h3>ODM at a Glance</h3>
+ <ul>
+ <li>Includes a growing catalog of packaged ingestion pipelines for common data sources</li>
+ <li>Enriched events provide full context leading to better analytics and faster incident response</li>
+ <li>Organizations maintain and control a single copy of their security data</li>
+ </ul>
+ <p class="btn-margin"><a href="<?php echo BASE_URL; ?>/project-components/open-data-models/" class="y-btn">Read More</a></p>
+ </div>
+ </div>
+ </div>
+
+ <div id="user-stories">
+ <div class="wrap cf">
+ <h1>Spot Fosters a Rich Application Ecosystem</h1>
+ <p class="btn-margin center">
+ Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
+ </p>
+
+ <p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
+
+ <div class="community">
+ <img src="library/images/community/endgame.png" alt="Endgame" />
+ <img src="library/images/community/intel.png" alt="Intel" />
+ <img src="library/images/community/webroot.png" alt="Webroot" />
+ <img src="library/images/community/jask.png" alt="Jask" />
+ <img src="library/images/community/cloudera.png" alt="Cloudera" />
+ <img src="library/images/community/cloudwick.png" alt="Cloudwick" />
+ <img src="library/images/community/cybraics.png" alt="Cybraics" />
+ <img src="library/images/community/centrify.png" alt="Centrify" />
+ <img src="library/images/community/ebay.png" alt="Ebay" />
+ <img src="library/images/community/semantix.png" alt="Ebay" />
+ <img src="library/images/community/rich-it.png" alt="Ebay" />
+
+ </div>
+
+ </div>
+ </div>
+
+ <div id="use-case">
+ <div class="wrap cf">
+
+ <h1>Use Case</h1>
+ <div class="quotes">
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/quote-person.png" alt="" />
+ <h3>Senior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/quote-person.png" alt="" />
+ <h3>Junior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/quote-person.png" alt="" />
+ <h3>Decision Maker</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ </div>
+
+ </div>
+
+ <div class="arrow">
+ <div class="wrap cf">
+ <p>
+ Identify the needle in the haystack with <strong>patterns</strong> that provide insight into potential threats.
+ </p>
+ </div>
+ </div>
+ </div>
+
+<?php include 'includes/prefooter.php'; ?>
+<?php include 'includes/footer.php'; ?>
\ No newline at end of file
diff --git a/library/css/meanmenu.css b/library/css/meanmenu.css
new file mode 100755
index 0000000..3cf6e41
--- /dev/null
+++ b/library/css/meanmenu.css
@@ -0,0 +1,170 @@
+
+/*! #######################################################################
+
+ MeanMenu 2.0.7
+ --------
+
+ To be used with jquery.meanmenu.js by Chris Wharton (http://www.meanthemes.com/plugins/meanmenu/)
+
+####################################################################### */
+
+/* hide the link until viewport size is reached */
+a.meanmenu-reveal {
+ display: none;
+}
+
+/* when under viewport size, .mean-container is added to body */
+.mean-container .mean-bar {
+ float: left;
+ width: 100%;
+ position: relative;
+ background: #e8e5e0;
+ padding: 4px 0;
+ min-height: 42px;
+ z-index: 999999;
+}
+
+.mean-container a.meanmenu-reveal {
+ width: 22px;
+ height: 22px;
+ padding: 13px 13px 11px 13px;
+ position: absolute;
+ top: 0;
+ right: 0;
+ cursor: pointer;
+ color: #c97644;
+ text-decoration: none;
+ font-size: 16px;
+ text-indent: -9999em;
+ line-height: 22px;
+ font-size: 1px;
+ display: block;
+ font-family: Arial, Helvetica, sans-serif;
+ font-weight: 700;
+}
+
+.mean-container a.meanmenu-reveal span {
+ display: block;
+ background: #c97644;
+ height: 3px;
+ margin-top: 3px;
+}
+
+.mean-container .mean-nav {
+ float: left;
+ width: 100%;
+ background: #e8e5e0;
+ margin-top: 44px;
+}
+
+.mean-container .mean-nav ul {
+ padding: 0;
+ margin: 0;
+ width: 100%;
+ list-style-type: none;
+ font-weight:600;
+}
+
+.mean-container .mean-nav ul li {
+ position: relative;
+ float: left;
+ width: 100%;
+ margin-bottom:0;
+}
+
+.mean-container .mean-nav ul li a {
+ display: block;
+ float: left;
+ width: 90%;
+ padding: 1em 5%;
+ margin: 0;
+ text-align: left;
+ color: #c97644;
+ border-top: 1px solid #c97644;
+ border-top: 1px solid rgba(255,255,255,0.8);
+ text-decoration: none;
+ text-transform: uppercase;
+}
+
+.mean-container .mean-nav ul li li a {
+ width: 80%;
+ padding: 1em 10%;
+ border-top: 1px solid #f1f1f1;
+ border-top: 1px solid rgba(255,255,255,0.25);
+/* opacity: 0.75;
+ filter: alpha(opacity=75);*/
+ text-shadow: none !important;
+ visibility: visible;
+}
+
+.mean-container .mean-nav ul li.mean-last a {
+ border-bottom: none;
+ margin-bottom: 0;
+}
+
+.mean-container .mean-nav ul li li li a {
+ width: 70%;
+ padding: 1em 15%;
+}
+
+.mean-container .mean-nav ul li li li li a {
+ width: 60%;
+ padding: 1em 20%;
+}
+
+.mean-container .mean-nav ul li li li li li a {
+ width: 50%;
+ padding: 1em 25%;
+}
+
+.mean-container .mean-nav ul li a:hover {
+ background: #252525;
+ background: rgba(255,255,255,0.1);
+}
+
+.mean-container .mean-nav ul li a.mean-expand {
+ margin-top: 1px;
+ width: 26px;
+ height: 32px;
+ padding:13px 12px 10px !important;
+ text-align: center;
+ position: absolute;
+ right: 0;
+ top: 0;
+ z-index: 2;
+ font-weight: 700;
+ background: rgba(255,255,255,0.1);
+ border: none !important;
+ border-left: 1px solid rgba(255,255,255,0.4) !important;
+ border-bottom: 1px solid rgba(255,255,255,0.2) !important;
+}
+
+.mean-container .mean-nav ul li a.mean-expand:hover {
+ background: #c97644;
+ color:#fff;
+}
+.mean-container .mean-push {
+ float: left;
+ width: 100%;
+ padding: 0;
+ margin: 0;
+ clear: both;
+}
+
+.mean-nav .wrapper {
+ width: 100%;
+ padding: 0;
+ margin: 0;
+}
+
+/* Fix for box sizing on Foundation Framework etc. */
+.mean-container .mean-bar, .mean-container .mean-bar * {
+ -webkit-box-sizing: content-box;
+ -moz-box-sizing: content-box;
+ box-sizing: content-box;
+}
+
+
+.mean-remove {
+ display: none !important;
+}
diff --git a/library/css/style.css b/library/css/style.css
new file mode 100755
index 0000000..7381745
--- /dev/null
+++ b/library/css/style.css
@@ -0,0 +1,1189 @@
+@import url("https://fonts.googleapis.com/css?family=Roboto+Condensed:400,300,700");
+@import url("https://fonts.googleapis.com/css?family=Open+Sans:400,300,400italic,300italic,600,600italic,700,700italic,800,800italic");
+
+@font-face {
+ font-family: 'icomoon';
+ src: url('../fonts/icomoon.eot?z8h1zd');
+ src: url('../fonts/icomoon.eot?z8h1zd#iefix') format('embedded-opentype'),
+ url('../fonts/icomoon.ttf?z8h1zd') format('truetype'),
+ url('../fonts/icomoon.woff?z8h1zd') format('woff'),
+ url('../fonts/icomoon.svg?z8h1zd#icomoon') format('svg');
+ font-weight: normal;
+ font-style: normal;
+}
+
+[class^="icon-"], [class*=" icon-"] {
+ /* use !important to prevent issues with browser extensions that change fonts */
+ font-family: 'icomoon' !important;
+ speak: none;
+ font-style: normal;
+ font-weight: normal;
+ font-variant: normal;
+ text-transform: none;
+ line-height: 1;
+
+ /* Better Font Rendering =========== */
+ -webkit-font-smoothing: antialiased;
+ -moz-osx-font-smoothing: grayscale;
+}
+
+.icon-envelope:before {
+ content: "\e903";
+}
+.icon-twitter:before {
+ content: "\e901";
+}
+.icon-slack:before {
+ content: "\e909";
+}
+.icon-keyboard_arrow_right:before {
+ content: "\e900";
+}
+
+/* Made with Bones: http://themble.com/bones :) */
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Main Stylesheet
+
+Here's where the magic happens. Here, you'll see we are calling in
+the separate media queries. The base mobile goes outside any query
+and is called at the beginning, after that we call the rest
+of the styles inside media queries.
+
+Helpful articles on Sass file organization:
+http://thesassway.com/advanced/modular-css-naming-conventions
+
+******************************************************************/
+/*********************
+IMPORTING PARTIALS
+These files are needed at the beginning so that we establish all
+our mixins, functions, and variables that we'll be using across
+the whole project.
+*********************/
+/* normalize.css 2012-07-07T09:50 UTC - http://github.com/necolas/normalize.css */
+/* ========================================================================== HTML5 display definitions ========================================================================== */
+/** Correct `block` display not defined in IE 8/9. */
+article, aside, details, figcaption, figure, footer, header, hgroup, main, nav, section, summary { display: block; }
+
+/** Correct `inline-block` display not defined in IE 8/9. */
+audio, canvas, video { display: inline-block; }
+
+/** Prevent modern browsers from displaying `audio` without controls. Remove excess height in iOS 5 devices. */
+audio:not([controls]) { display: none; height: 0; }
+
+/** Address `[hidden]` styling not present in IE 8/9. Hide the `template` element in IE, Safari, and Firefox < 22. */
+[hidden], template { display: none; }
+
+/* ========================================================================== Base ========================================================================== */
+/** 1. Set default font family to sans-serif. 2. Prevent iOS text size adjust after orientation change, without disabling user zoom. */
+html { font-family: sans-serif; /* 1 */ -ms-text-size-adjust: 100%; /* 2 */ -webkit-text-size-adjust: 100%; /* 2 */ }
+
+/** Remove default margin. */
+body { margin: 0; }
+
+/* ========================================================================== Links ========================================================================== */
+/** Remove the gray background color from active links in IE 10. */
+a { background: transparent; }
+
+/** Address `outline` inconsistency between Chrome and other browsers. */
+a:focus { outline: thin dotted; }
+
+/** Improve readability when focused and also mouse hovered in all browsers. */
+a:active, a:hover { outline: 0; }
+
+/* ========================================================================== Typography ========================================================================== */
+/** Address variable `h1` font-size and margin within `section` and `article` contexts in Firefox 4+, Safari 5, and Chrome. */
+h1 { font-size: 2em; margin: 0.67em 0; }
+
+/** Address styling not present in IE 8/9, Safari 5, and Chrome. */
+abbr[title] { border-bottom: 1px dotted; }
+
+/** Address style set to `bolder` in Firefox 4+, Safari 5, and Chrome. */
+b, strong, .strong { font-weight: bold; }
+
+/** Address styling not present in Safari 5 and Chrome. */
+dfn, em, .em { font-style: italic; }
+
+/** Address differences between Firefox and other browsers. */
+hr { -moz-box-sizing: content-box; box-sizing: content-box; height: 0; }
+
+/* proper formatting (http://blog.fontdeck.com/post/9037028497/hyphens)
+*/
+p { -webkit-hyphens: auto; -epub-hyphens: auto; -moz-hyphens: auto; hyphens: auto; }
+
+/* Addresses margins set differently in IE6/7. */
+pre { margin: 0; }
+
+/** Correct font family set oddly in Safari 5 and Chrome. */
+code, kbd, pre, samp { font-family: monospace, serif; font-size: 1em; }
+
+/** Improve readability of pre-formatted text in all browsers. */
+pre { white-space: pre-wrap; }
+
+/** Set consistent quote types. */
+q { quotes: "\201C" "\201D" "\2018" "\2019"; }
+
+/** Address inconsistent and variable font size in all browsers. */
+q:before, q:after { content: ''; content: none; }
+
+small, .small { font-size: 75%; }
+
+/** Prevent `sub` and `sup` affecting `line-height` in all browsers. */
+sub, sup { font-size: 75%; line-height: 0; position: relative; vertical-align: baseline; }
+
+sup { top: -0.5em; }
+
+sub { bottom: -0.25em; }
+
+/* ========================================================================== Lists
+========================================================================== */
+/* Addresses margins set differently in IE6/7. */
+dl, menu, ol, ul { margin: 1em 0; }
+
+dd { margin: 0; }
+
+/* Addresses paddings set differently in IE6/7. */
+menu { padding: 0 0 0 40px; }
+
+ol, ul { padding: 0; /*list-style-type: none;*/ }
+
+/* Corrects list images handled incorrectly in IE7. */
+nav ul, nav ol { list-style: none; list-style-image: none; }
+
+/* ========================================================================== Embedded content
+========================================================================== */
+/** Remove border when inside `a` element in IE 8/9. */
+img { border: 0; }
+
+/** Correct overflow displayed oddly in IE 9. */
+svg:not(:root) { overflow: hidden; }
+
+/* ========================================================================== Figures ========================================================================== */
+/** Address margin not present in IE 8/9 and Safari 5. */
+figure { margin: 0; }
+
+/* ========================================================================== Forms ========================================================================== */
+/** Define consistent border, margin, and padding. */
+fieldset { border: 1px solid #c0c0c0; margin: 0 2px; padding: 0.35em 0.625em 0.75em; }
+
+/** 1. Correct `color` not being inherited in IE 8/9. 2. Remove padding so people aren't caught out if they zero out fieldsets. */
+legend { border: 0; /* 1 */ padding: 0; /* 2 */ }
+
+/** 1. Correct font family not being inherited in all browsers. 2. Correct font size not being inherited in all browsers. 3. Address margins set differently in Firefox 4+, Safari 5, and Chrome. */
+button, input, select, textarea { font-family: inherit; /* 1 */ font-size: 100%; /* 2 */ margin: 0; /* 3 */ }
+
+/** Address Firefox 4+ setting `line-height` on `input` using `!important` in the UA stylesheet. */
+button, input { line-height: normal; }
+
+/** Address inconsistent `text-transform` inheritance for `button` and `select`. All other form control elements do not inherit `text-transform` values. Correct `button` style inheritance in Chrome, Safari 5+, and IE 8+. Correct `select` style inheritance in Firefox 4+ and Opera. */
+button, select { text-transform: none; }
+
+/** 1. Avoid the WebKit bug in Android 4.0.* where (2) destroys native `audio` and `video` controls. 2. Correct inability to style clickable `input` types in iOS. 3. Improve usability and consistency of cursor style between image-type `input` and others. */
+button, html input[type="button"], input[type="reset"], input[type="submit"] { -webkit-appearance: button; /* 2 */ cursor: pointer; /* 3 */ }
+
+/** Re-set default cursor for disabled elements. */
+button[disabled], html input[disabled] { cursor: default; }
+
+/** 1. Address box sizing set to `content-box` in IE 8/9/10. 2. Remove excess padding in IE 8/9/10. */
+input[type="checkbox"], input[type="radio"] { box-sizing: border-box; /* 1 */ padding: 0; /* 2 */ }
+
+/** 1. Address `appearance` set to `searchfield` in Safari 5 and Chrome. 2. Address `box-sizing` set to `border-box` in Safari 5 and Chrome (include `-moz` to future-proof). */
+input[type="search"] { -webkit-appearance: textfield; /* 1 */ -moz-box-sizing: content-box; -webkit-box-sizing: content-box; /* 2 */ box-sizing: content-box; }
+
+/** Remove inner padding and search cancel button in Safari 5 and Chrome on OS X. */
+input[type="search"]::-webkit-search-cancel-button, input[type="search"]::-webkit-search-decoration { -webkit-appearance: none; }
+
+/** Remove inner padding and border in Firefox 4+. */
+button::-moz-focus-inner, input::-moz-focus-inner { border: 0; padding: 0; }
+
+/** 1. Remove default vertical scrollbar in IE 8/9. 2. Improve readability and alignment in all browsers. */
+textarea { overflow: auto; /* 1 */ vertical-align: top; /* 2 */ }
+
+/* ========================================================================== Tables ========================================================================== */
+/** Remove most spacing between table cells. */
+table { border-collapse: collapse; border-spacing: 0; }
+
+* { -webkit-box-sizing: border-box; -moz-box-sizing: border-box; box-sizing: border-box; }
+
+.image-replacement, .ir { text-indent: 100%; white-space: nowrap; overflow: hidden; }
+
+.clearfix, .cf, .comment-respond { zoom: 1; }
+.clearfix:before, .clearfix:after, .cf:before, .comment-respond:before, .cf:after, .comment-respond:after { content: ""; display: table; }
+.clearfix:after, .cf:after, .comment-respond:after { clear: both; }
+
+/*
+use the best ampersand
+http://simplebits.com/notebook/2008/08/14/ampersands-2/
+*/
+span.amp { font-family: Baskerville,'Goudy Old Style',Palatino,'Book Antiqua',serif !important; font-style: italic; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Variables
+
+Here is where we declare all our variables like colors, fonts,
+base values, and defaults. We want to make sure this file ONLY
+contains variables that way our files don't get all messy.
+No one likes a mess.
+
+******************************************************************/
+/*********************
+COLORS
+Need help w/ choosing your colors? Try this site out:
+http://0to255.com/
+*********************/
+/*
+Here's a great tutorial on how to
+use color variables properly:
+http://sachagreif.com/sass-color-variables/
+*/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Typography
+
+Need to import a font or set of icons for your site? Drop them in
+here or just use this to establish your typographical grid. Or not.
+Do whatever you want to...GOSH!
+
+Helpful Articles:
+http://trentwalton.com/2012/06/19/fluid-type/
+http://ia.net/blog/responsive-typography-the-basics/
+http://alistapart.com/column/responsive-typography-is-a-physical-discipline
+
+******************************************************************/
+/*********************
+FONT FACE (IN YOUR FACE)
+*********************/
+/* To embed your own fonts, use this syntax and place your fonts inside the library/fonts folder. For more information on embedding fonts, go to: http://www.fontsquirrel.com/ Be sure to remove the comment brackets.
+*/
+/* @font-face { font-family: 'Font Name'; src: url('../css/library/fonts/font-name.eot'); src: url('../css/library/fonts/font-name.eot#iefix') format('embedded-opentype'), url('../css/library/fonts/font-name.woff') format('woff'), url('../css/library/fonts/font-name.ttf') format('truetype'), url('../css/library/fonts/font-name.svg#font-name') format('svg'); font-weight: normal; font-style: normal; }
+*/
+/*
+The following is based of Typebase:
+https://github.com/devinhunt/typebase.css
+I've edited it a bit, but it's a nice starting point.
+*/
+/* i imported this one in the functions file so bones would look sweet. don't forget to remove it for your site.
+*/
+/*
+some nice typographical defaults
+more here: http://www.newnet-soft.com/blog/csstypography
+*/
+p { -ms-word-wrap: break-word; word-break: break-word; word-wrap: break-word; -webkit-hyphens: auto; -moz-hyphens: auto; hyphens: auto; -webkit-hyphenate-before: 2; -webkit-hyphenate-after: 3; hyphenate-lines: 3; -webkit-font-feature-settings: "liga", "dlig"; -moz-font-feature-settings: "liga=1, dlig=1"; -ms-font-feature-settings: "liga", "dlig"; -o-font-feature-settings: "liga", "dlig"; font-feature-settings: "liga", "dlig"; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Sass Functions
+
+You can do a lot of really cool things in Sass. Functions help you
+make repeated actions a lot easier. They are really similar to mixins,
+but can be used for so much more.
+
+Anyway, keep them all in here so it's easier to find when you're
+looking for one.
+
+For more info on functions, go here:
+http://sass-lang.com/documentation/Sass/Script/Functions.html
+
+******************************************************************/
+/*********************
+COLOR FUNCTIONS
+These are helpful when you're working
+with shadows and such things. It's essentially
+a quicker way to write RGBA.
+
+Example:
+box-shadow: 0 0 4px black(0.3);
+compiles to:
+box-shadow: 0 0 4px rgba(0,0,0,0.3);
+*********************/
+/*********************
+RESPONSIVE HELPER FUNCTION
+If you're creating a responsive site, then
+you've probably already read
+Responsive Web Design: http://www.abookapart.com/products/responsive-web-design
+
+Here's a nice little helper function for calculating
+target / context
+as mentioned in that book.
+
+Example:
+width: cp(650px, 1000px);
+or
+width: calc-percent(650px, 1000px);
+both compile to:
+width: 65%;
+*********************/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Mixins Stylesheet
+
+This is where you can take advantage of Sass' great features: Mixins.
+I won't go in-depth on how they work exactly,
+there are a few articles below that will help do that. What I will
+tell you is that this will help speed up simple changes like
+changing a color or adding CSS3 techniques gradients.
+
+A WORD OF WARNING: It's very easy to overdo it here. Be careful and
+remember less is more.
+
+Helpful:
+http://sachagreif.com/useful-sass-mixins/
+http://thesassway.com/intermediate/leveraging-sass-mixins-for-cleaner-code
+http://web-design-weekly.com/blog/2013/05/12/handy-sass-mixins/
+
+******************************************************************/
+/*********************
+TRANSITION
+*********************/
+/*
+I totally rewrote this to be cleaner and easier to use.
+You'll need to be using Sass 3.2+ for these to work.
+Thanks to @anthonyshort for the inspiration on these.
+USAGE: @include transition(all 0.2s ease-in-out);
+*/
+/*********************
+CSS3 GRADIENTS
+Be careful with these since they can
+really slow down your CSS. Don't overdo it.
+*********************/
+/* @include css-gradient(#dfdfdf,#f8f8f8); */
+/*********************
+BOX SIZING
+*********************/
+/* @include box-sizing(border-box); */
+/* NOTE: value of "padding-box" is only supported in Gecko. So
+probably best not to use it. I mean, were you going to anyway? */
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Grid Stylesheet
+
+I've seperated the grid so you can swap it out easily. It's
+called at the top the style.scss stylesheet.
+
+There are a ton of grid solutions out there. You should definitely
+experiment with your own. Here are some recommendations:
+
+http://gridsetapp.com - Love this site. Responsive Grids made easy.
+http://susy.oddbird.net/ - Grids using Compass. Very elegant.
+http://gridpak.com/ - Create your own responsive grid.
+https://github.com/dope/lemonade - Neat lightweight grid.
+
+
+The grid below is a custom built thingy I modeled a bit after
+Gridset. It's VERY basic and probably shouldn't be used on
+your client projects. The idea is you learn how to roll your
+own grids. It's better in the long run and allows you full control
+over your project's layout.
+
+******************************************************************/
+.last-col { float: right; padding-right: 0 !important; }
+
+/*
+Mobile Grid Styles
+These are the widths for the mobile grid.
+There are four types, but you can add or customize
+them however you see fit.
+*/
+@media (max-width: 767px) { .m-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .m-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .m-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .m-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .m-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .m-3of4 { float: left; padding-right: 0.75em; width: 75%; } }
+/* Portrait tablet to landscape */
+@media (min-width: 768px) and (max-width: 1029px) { .t-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .t-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .t-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .t-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .t-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .t-3of4 { float: left; padding-right: 0.75em; width: 75%; }
+ .t-1of5 { float: left; padding-right: 0.75em; width: 20%; }
+ .t-2of5 { float: left; padding-right: 0.75em; width: 40%; }
+ .t-3of5 { float: left; padding-right: 0.75em; width: 60%; }
+ .t-4of5 { float: left; padding-right: 0.75em; width: 80%; } }
+/* Landscape to small desktop */
+@media (min-width: 1030px) { .d-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .d-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .d-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .d-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .d-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .d-3of4 { float: left; padding-right: 0.75em; width: 75%; }
+ .d-1of5 { float: left; padding-right: 0.75em; width: 20%; }
+ .d-2of5 { float: left; padding-right: 0.75em; width: 40%; }
+ .d-3of5 { float: left; padding-right: 0.75em; width: 60%; }
+ .d-4of5 { float: left; padding-right: 0.75em; width: 80%; }
+ .d-1of6 { float: left; padding-right: 0.75em; width: 16.6666666667%; }
+ .d-1of7 { float: left; padding-right: 0.75em; width: 14.2857142857%; }
+ .d-2of7 { float: left; padding-right: 0.75em; width: 28.5714286%; }
+ .d-3of7 { float: left; padding-right: 0.75em; width: 42.8571429%; }
+ .d-4of7 { float: left; padding-right: 0.75em; width: 57.1428572%; }
+ .d-5of7 { float: left; padding-right: 0.75em; width: 71.4285715%; }
+ .d-6of7 { float: left; padding-right: 0.75em; width: 85.7142857%; }
+ .d-1of8 { float: left; padding-right: 0.75em; width: 12.5%; }
+ .d-1of9 { float: left; padding-right: 0.75em; width: 11.1111111111%; }
+ .d-1of10 { float: left; padding-right: 0.75em; width: 10%; }
+ .d-1of11 { float: left; padding-right: 0.75em; width: 9.09090909091%; }
+ .d-1of12 { float: left; padding-right: 0.75em; width: 8.33%; } }
+/*********************
+IMPORTING MODULES
+Modules are reusable blocks or elements we use throughout the project.
+We can break them up as much as we want or just keep them all in one.
+I mean, you can do whatever you want. The world is your oyster. Unless
+you hate oysters, then the world is your peanut butter & jelly sandwich.
+*********************/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Alert Styles
+
+If you want to use these alerts in your design, you can. If not,
+you can just remove this stylesheet.
+
+******************************************************************/
+.alert-help, .alert-info, .alert-error, .alert-success { margin: 10px; padding: 5px 18px; border: 1px solid; }
+
+.alert-help { border-color: #e8dc59; background: #ebe16f; }
+
+.alert-info { border-color: #bfe4f4; background: #d5edf8; }
+
+.alert-error { border-color: #f8cdce; background: #fbe3e4; }
+
+.alert-success { border-color: #deeaae; background: #e6efc2; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Button Styles
+
+Buttons are a pretty important part of your site's style, so it's
+important to have a consistent baseline for them. Use this stylesheet
+to create all kinds of buttons.
+
+Helpful Links:
+http://galp.in/blog/2011/08/02/the-ui-guide-part-1-buttons/
+
+******************************************************************/
+/*********************
+BUTTON DEFAULTS
+We're gonna use a placeholder selector here
+so we can use common styles. We then use this
+to load up the defaults in all our buttons.
+
+Here's a quick video to show how it works:
+http://www.youtube.com/watch?v=hwdVpKiJzac
+
+*********************/
+.blue-btn, .comment-reply-link, #submit { display: inline-block; position: relative; font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; text-decoration: none; color: white; font-size: 0.9em; font-size: 34px; line-height: 34px; font-weight: normal; padding: 0 24px; border-radius: 4px; border: 0; cursor: pointer; -webkit-transition: background-color 0.14s ease-in-out; transition: background-color 0.14s ease-in-out; }
+.blue-btn:hover, .comment-reply-link:hover, #submit:hover, .blue-btn:focus, .comment-reply-link:focus, #submit:focus { color: white; text-decoration: none; outline: none; }
+.blue-btn:active, .comment-reply-link:active, #submit:active { top: 1px; }
+
+/*
+An example button.
+You can use this example if you want. Just replace all the variables
+and it will create a button dependant on those variables.
+*/
+.blue-btn, .comment-reply-link, #submit { background-color: #2980b9; }
+.blue-btn:hover, .comment-reply-link:hover, #submit:hover, .blue-btn:focus, .comment-reply-link:focus, #submit:focus { background-color: #2574a8; }
+.blue-btn:active, .comment-reply-link:active, #submit:active { background-color: #2472a4; }
+
+.y-btn, .y-btn:visited { background: transparent; padding: 10px 35px; border: 2px solid #c97644; color: #c97644; text-align:center;text-decoration: none; font-weight: bold; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; text-transform: uppercase; letter-spacing: 1px; font-size: 10.5pt; -webkit-transition: all .3s ease; -moz-transition: all .3s ease; -ms-transition: all .3s ease; -o-transition: all .3s ease; transition: all .3s ease; display:block;margin:0 auto [...]
+.y-btn:hover, .y-btn:focus, .y-btn:active, .y-btn:visited:hover, .y-btn:visited:focus, .y-btn:visited:active { background: #c97644; color: white; }
+
+.btn-margin { margin-top: 50px; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Form Styles
+
+We put all the form and button styles in here to setup a consistent
+look. If we need to customize them, we can do this in the main
+stylesheets and just override them. Easy Peasy.
+
+You're gonna see a few data-uri thingies down there. If you're not
+sure what they are, check this link out:
+http://css-tricks.com/data-uris/
+If you want to create your own, use this helpful link:
+http://websemantics.co.uk/online_tools/image_to_data_uri_convertor/
+
+******************************************************************/
+/*********************
+INPUTS
+*********************/
+input[type="text"], input[type="password"], input[type="datetime"], input[type="datetime-local"], input[type="date"], input[type="month"], input[type="time"], input[type="week"], input[type="number"], input[type="email"], input[type="url"], input[type="search"], input[type="tel"], input[type="color"], select, textarea, .field { display: block; height: 40px; line-height: 1em; padding: 0 12px; margin-bottom: 14px; font-size: 1em; color: #5c6b80; border-radius: 3px; vertical-align: middle; [...]
+input[type="text"]:focus, input[type="text"]:active, input[type="password"]:focus, input[type="password"]:active, input[type="datetime"]:focus, input[type="datetime"]:active, input[type="datetime-local"]:focus, input[type="datetime-local"]:active, input[type="date"]:focus, input[type="date"]:active, input[type="month"]:focus, input[type="month"]:active, input[type="time"]:focus, input[type="time"]:active, input[type="week"]:focus, input[type="week"]:active, input[type="number"]:focus, in [...]
+input[type="text"].error, input[type="text"].is-invalid, input[type="password"].error, input[type="password"].is-invalid, input[type="datetime"].error, input[type="datetime"].is-invalid, input[type="datetime-local"].error, input[type="datetime-local"].is-invalid, input[type="date"].error, input[type="date"].is-invalid, input[type="month"].error, input[type="month"].is-invalid, input[type="time"].error, input[type="time"].is-invalid, input[type="week"].error, input[type="week"].is-invalid [...]
+input[type="text"].success, input[type="text"].is-valid, input[type="password"].success, input[type="password"].is-valid, input[type="datetime"].success, input[type="datetime"].is-valid, input[type="datetime-local"].success, input[type="datetime-local"].is-valid, input[type="date"].success, input[type="date"].is-valid, input[type="month"].success, input[type="month"].is-valid, input[type="time"].success, input[type="time"].is-valid, input[type="week"].success, input[type="week"].is-valid [...]
+input[type="text"][disabled], input[type="text"].is-disabled, input[type="password"][disabled], input[type="password"].is-disabled, input[type="datetime"][disabled], input[type="datetime"].is-disabled, input[type="datetime-local"][disabled], input[type="datetime-local"].is-disabled, input[type="date"][disabled], input[type="date"].is-disabled, input[type="month"][disabled], input[type="month"].is-disabled, input[type="time"][disabled], input[type="time"].is-disabled, input[type="week"][d [...]
+input[type="text"][disabled]:focus, input[type="text"][disabled]:active, input[type="text"].is-disabled:focus, input[type="text"].is-disabled:active, input[type="password"][disabled]:focus, input[type="password"][disabled]:active, input[type="password"].is-disabled:focus, input[type="password"].is-disabled:active, input[type="datetime"][disabled]:focus, input[type="datetime"][disabled]:active, input[type="datetime"].is-disabled:focus, input[type="datetime"].is-disabled:active, input[type [...]
+
+input[type="password"] { letter-spacing: 0.3em; }
+
+textarea { max-width: 100%; min-height: 120px; line-height: 1.5em; }
+
+select { -webkit-appearance: none; /* 1 */ -moz-appearance: none; appearance: none; background-image: url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA8AAAAHCAYAAADXhRcnAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAAyRpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuMy1jMDExIDY2LjE0NTY2MSwgMjAxMi8wMi8wNi0xNDo1NjoyNyAgICAgICAgIj4gPHJkZjpSREYg [...]
+
+form#searchform input#searchsubmit { background: transparent url(../images/search.png) top left no-repeat; width: 50px; padding-left: 5px; display: block; overflow: hidden; /* Hack for IE */ text-indent: -9999px; font-size: 0px; line-height: 0px; }
+
+/*********************
+BASE (MOBILE) SIZE
+This are the mobile styles. It's what people see on their phones. If
+you set a great foundation, you won't need to add too many styles in
+the other stylesheets. Remember, keep it light: Speed is Important.
+*********************/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Base Mobile Stylesheet
+
+Be light and don't over style since everything here will be
+loaded by mobile devices. You want to keep it as minimal as
+possible. This is called at the top of the main stylsheet
+and will be used across all viewports.
+
+******************************************************************/
+/*********************
+GENERAL STYLES
+*********************/
+body { font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-size: 100%; line-height: 1.5; color: #0b0b0b; background-color: #f7f7f7; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; }
+
+p { -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; letter-spacing: 1px; line-height: 1.8em; font-size: 11pt; }
+
+ol {padding-left:20px;font-size:11pt;line-height:1.8em;letter-spacing:1px;}
+
+ul{padding-left:20px;list-style-image:url('../images/bullet.png');font-size:11pt;line-height:1.8em;letter-spacing:1px;}
+ul li {margin-bottom:10px;}
+
+img { max-width: 100%; height: auto; }
+
+.header { box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -webkit-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -moz-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); }
+
+.thin {font-weight:400;}
+/********************
+WORDPRESS BODY CLASSES
+style a page via class
+********************/
+/* for sites that are read right to left (i.e. hebrew) */
+/* home page */
+/* blog template page */
+/* archive page */
+/* date archive page */
+/* replace the number to the corresponding page number */
+/* search page */
+/* search result page */
+/* no results search page */
+/* individual paged search (i.e. body.search-paged-3) */
+/* 404 page */
+/* single post page */
+/* individual post page by id (i.e. body.postid-73) */
+/* individual paged single (i.e. body.single-paged-3) */
+/* attatchment page */
+/* individual attatchment page (i.e. body.attachmentid-763) */
+/* style mime type pages */
+/* author page */
+/* user nicename (i.e. body.author-samueladams) */
+/* paged author archives (i.e. body.author-paged-4) for page 4 */
+/* category page */
+/* individual category page (i.e. body.category-6) */
+/* replace the number to the corresponding page number */
+/* tag page */
+/* individual tag page (i.e. body.tag-news) */
+/* replace the number to the corresponding page number */
+/* custom page template page */
+/* individual page template (i.e. body.page-template-contact-php */
+/* replace the number to the corresponding page number */
+/* parent page template */
+/* child page template */
+/* replace the number to the corresponding page number */
+/* if user is logged in */
+/* paged items like search results or archives */
+/* individual paged (i.e. body.paged-3) */
+/*********************
+LAYOUT & GRID STYLES
+*********************/
+.wrap { width: 85%; margin: 0 auto; }
+
+.center { text-align: center; }
+
+.table { display: table; border-collapse: separate; }
+
+.table-row { display: table-row; }
+
+.table-cell { display: table-cell; vertical-align: middle; }
+
+.table-cell.quote-man {text-align:center;min-width:171px;}
+.quotes .table-cell {text-align:center;}
+
+.disclaimer {color:#fff;font-size:.7em;line-height:1.3em;}
+
+
+/*********************
+BACK TO TOP
+*********************/
+.cd-container {
+ width: 90%;
+ max-width: 768px;
+ margin: 2em auto;
+}
+.cd-container::after {
+ /* clearfix */
+ content: '';
+ display: table;
+ clear: both;
+}
+.cd-top {
+ display: inline-block;
+ height: 40px;
+ width: 40px;
+ position: fixed;
+ bottom: 40px;
+ right: 10px;
+ box-shadow: 0 0 10px rgba(0, 0, 0, 0.05);
+ /* image replacement properties */
+ overflow: hidden;
+ text-indent: 100%;
+ white-space: nowrap;
+ background: rgba(201, 118, 68, 0.8) url('../images/cd-top-arrow.svg') no-repeat center 50%;
+ visibility: hidden;
+ opacity: 0;
+ -webkit-transition: opacity .3s 0s, visibility 0s .3s;
+ -moz-transition: opacity .3s 0s, visibility 0s .3s;
+ transition: opacity .3s 0s, visibility 0s .3s;
+}
+.cd-top.cd-is-visible, .cd-top.cd-fade-out, .no-touch .cd-top:hover {
+ -webkit-transition: opacity .3s 0s, visibility 0s 0s;
+ -moz-transition: opacity .3s 0s, visibility 0s 0s;
+ transition: opacity .3s 0s, visibility 0s 0s;
+}
+.cd-top.cd-is-visible {
+ /* the button becomes visible */
+ visibility: visible;
+ opacity: 1;
+}
+.cd-top.cd-fade-out {
+ /* if the user keeps scrolling down, the button is out of focus and becomes less visible */
+ opacity: .5;
+}
+.no-touch .cd-top:hover {
+ background-color: #c97644;
+ opacity: 1;
+}
+
+/*********************
+LINK STYLES
+*********************/
+a, a:visited { color: #c97644; -webkit-transition: color .3s ease; -moz-transition: color .3s ease; -ms-transition: color .3s ease; -o-transition: color .3s ease; transition: color .3s ease; text-decoration: none; /* on hover */ /* on click */ /* mobile tap color */ }
+a:hover, a:focus, a:visited:hover, a:visited:focus { color: #3e3e40; }
+a:link, a:visited:link { /*
+this highlights links on iPhones/iPads.
+so it basically works like the :hover selector
+for mobile devices.
+*/ -webkit-tap-highlight-color: rgba(0, 0, 0, 0.3); }
+
+/******************************************************************
+H1, H2, H3, H4, H5 STYLES
+******************************************************************/
+h1, .h1, h2, .h2, h3, .h3, h4, .h4, h5, .h5 { text-rendering: optimizelegibility; font-weight: 500; color: #c97644;letter-spacing:2px; /*
+if you're going to use webfonts, be sure to check your weights
+http://css-tricks.com/watch-your-font-weight/
+*/ /* removing text decoration from all headline links */ }
+h1 a, .h1 a, h2 a, .h2 a, h3 a, .h3 a, h4 a, .h4 a, h5 a, .h5 a { text-decoration: none; }
+
+h1, .h1 { font-size: 2.2em; line-height: 1.333em; }
+
+h2, .h2 { font-size: 1.75em; line-height: 1.4em; margin-bottom: 0.375em; }
+
+h3, .h3 { font-size: 1.125em; }
+
+h4, .h4 { font-size: 1.1em; font-weight: 700; }
+
+h5, .h5 { font-size: 0.846em; line-height: 2.09em; text-transform: uppercase; letter-spacing: 2px; }
+
+/*********************
+HEADER STYLES
+*********************/
+.header { background-color: white; }
+
+#logo { margin: 25px 0 15px; text-align: center; }
+#logo a { color: white; }
+
+#masthead { background: url("../images/masthead-bg.jpg") no-repeat bottom center; background-size: cover; clear: both; padding: 50px 0; -webkit-box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); text-align: center; }
+#masthead h1 { color: #f9bf12; line-height: 1.2em; max-width: 600px; text-align: center; display: block; margin: 0 auto;color:#fff;font-weight:bold;letter-spacing:1px;}
+#masthead h1.thin {font-weight:400;}
+#masthead p { color: #fff; line-height: 1.8em; text-align: center; letter-spacing: 1px; font-size: 11pt; }
+#masthead .contribute h3 {color:#fff;letter-spacing:1px;font-size:1.3em;font-weight:500;}
+#masthead .btn-margin {text-align:center;margin:25px auto 0;max-width:250px;}
+#masthead .y-btn {padding:10px 15px;max-width:100%;color:#fff;border-color:#fff;}
+
+.page #masthead {text-align:center;}
+.page #masthead h1 {font-weight:400;}
+
+
+/*********************
+NAVIGATION STYLES
+*********************/
+/*
+all navs have a .nav class applied via
+the wp_menu function; this is so we can
+easily write one group of styles for
+the navs on the site so our css is cleaner
+and more scalable.
+*/
+.nav { border-bottom: 0; margin: 0; font-family: "Roboto", "Helvetica Neue", Helvetica, Arial, sans-serif; /* end .menu li */ /* highlight current page */ /* end current highlighters */ }
+.nav li { /*
+so you really have to rethink your dropdowns for mobile.
+you don't want to have it expand too much because the
+screen is so small. How you manage your menu should
+depend on the project. Here's some great info on it:
+http://www.alistapart.com/articles/organizing-mobile/
+*/ }
+.nav li a { display: block; color: white; text-decoration: none; padding: 0.75em; /*
+remember this is for mobile ONLY, so there's no need
+to even declare hover styles here, you can do it in
+the style.scss file where it's relevant. We want to
+keep this file as small as possible!
+*/ }
+.nav li ul.sub-menu li a, .nav li ul.children li a { padding-left: 30px; }
+.menu-item-has-children > a {cursor:default;}
+/* end .nav */
+/*********************
+POSTS & CONTENT STYLES
+*********************/
+.home { background: white; }
+.home #main img { margin: 50px 0; }
+.home .header { box-shadow: none; -webkit-box-shadow: none; -moz-box-shadow: none; }
+
+#at-a-glance {background:#e8e5e0;padding:50px 0;text-align:center;}
+#at-a-glance h1 {margin-top:0;color:#c97644;}
+
+#and { background: #4b4547; padding:35px 0 25px; color: #fff; }
+
+#how-it-works { padding: 50px 0 100px; background: #e8e5e0; text-align: center; border-bottom: 1px solid #e0e0e0; }
+#how-it-works img { display: block; margin: 50px auto 0; }
+
+#key-features { padding: 50px 0; /*background: white url("../images/key_features_bg.jpg") no-repeat top center; background-size: cover;*/background-color:#fff; border-top: 1px solid #efefef; }
+#key-features .d-1of2 { margin: 25px 0; }
+#key-features h1 { text-align: center; margin: 0 0 50px; }
+#key-features h3 { font-weight: bold; max-width: 200px; line-height: 1em; font-size: 16pt; font-weight: 600; color:#8e8506; }
+#key-features img { margin-right: 20px; }
+#key-features .btn-margin { clear: both; text-align: center; }
+
+#open-data-models {padding:50px 0;background:#d0cbc5;color:#535457;}
+
+
+#user-stories { background: #e8e5e0; padding: 50px 0; }
+#user-stories h1 { text-align: center; }
+#user-stories .intro { background: url("../images/quotes.png") no-repeat center center; text-align: center; font-weight: 600; padding: 25px 0; }
+#user-stories .table { margin-bottom: 25px; border-bottom: 1px solid #7e7f81; vertical-align: middle; }
+#user-stories .table:last-of-type { border-bottom: none; }
+#user-stories .table-cell { width: 100%; display: block; text-align: center; margin-bottom: 25px; }
+#user-stories .quote-man { text-align: center; width: 100%; }
+#user-stories .quote-man h3 { margin: 10px 0 20px; }
+
+.community {text-align:center;margin-top:35px;}
+.community img {display:inline;}
+
+#use-case { padding: 50px 0; background: #fff; }
+#use-case h1 { text-align: center; margin-bottom: 0; }
+#use-case h3 { color: #860309; text-align: center; font-weight: 500; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; letter-spacing: 1px; margin: 10px 0 35px; font-size: 13pt;line-height:1.3em; text-transform:uppercase;}
+#use-case .number { min-height: 100px; width: 95px; vertical-align: top; }
+#use-case .left img { margin-bottom: 50px; }
+#use-case .table { padding: 25px 0 25px 0; }
+#use-case .table:first-of-type { padding-top: 0; }
+#use-case .table p { font-size: 13pt; line-height: 1.3em; font-weight: 500; }
+#use-case .table p strong { font-weight: 800; }
+#use-case .table p:first-of-type { margin-top: 0; }
+.quotes {margin-top:50px;}
+.quotes .table-cell {display:block;}
+
+.arrow { margin: 50px 0 0; width: 100%; height: 150px; background-color: #c97644; position: relative;color:#fff; }
+.arrow p { margin: 20px 25px 20px 25px; font-size: 14pt; text-align: left; line-height: 1.2em; }
+
+#more-info { background: #4b4547; padding: 50px 0; }
+#more-info p { text-align: center; }
+
+.social-icons {text-align:center;margin-bottom:50px;}
+.social-icons a {font-size:2em;color:#fff;}
+.social-icons a:hover {color:#c97644;}
+.social-icons a:first-child {margin-right:15px;}
+.add-to-slack {margin:0 0 0 15px;}
+.add-to-slack {position:relative;top:5px;}
+
+#and .and-cell p {font-size:13pt;line-height:1.2em;}
+
+.citation {font-size:.7em;line-height:1.5em;margin:50px 0 15px;}
+
+#content { margin-top: 2em; }
+.page #content {margin-top:0;}
+
+.page .main {padding:50px 25px;}
+.page #content h3 {color:#a3a3a1;font-weight:700;text-transform:uppercase;line-height:1.3em;font-size:1.3em;}
+.page #content h4 {color:#8e8506;font-weight:400;}
+.page .wrap.with-sidebar {width:100%;}
+
+.hentry { padding: .75em; margin-bottom: 1.5em; }
+.hentry footer { padding: 1.5em 0; border-top: 1px solid #d6d6d6; }
+.hentry footer p { margin: 0; }
+
+/* end .hentry */
+.single-title, .page-title, .entry-title { margin: 0;line-height:1.2em; }
+
+/* want to style individual post classes? Booya! */
+/* post by id (i.e. post-3) */
+/* general post style */
+/* general article on a page style */
+/* general style on an attatchment */
+/* sticky post style */
+/* hentry class */
+/* style by category (i.e. category-videos) */
+/* style by tag (i.e. tag-news) */
+/* post meta */
+.byline { color: #9fa6b4; margin: 10px 0 0; font-size: 10pt; }
+
+/* entry content */
+.entry-content { padding: 1.5em 0; /*
+image alignment on a screen this size may be
+a bit difficult. It's set to start aligning
+and floating images at the next breakpoint,
+but it's up to you. Feel free to change it up.
+*/ }
+.entry-content ol {list-style-type:decimal;padding-left:40px;}
+.entry-content ul {list-style-type:disc;padding-left:40px;}
+.entry-content p { margin: 0 0 1.5em; }
+.entry-content table { width: 100%; border: 1px solid #626366; margin-bottom: 1.5em; }
+.entry-content table caption { margin: 0 0 7px; font-size: 0.75em; color: #9fa6b4; text-transform: uppercase; letter-spacing: 1px; }
+.entry-content tr { border-bottom: 1px solid #626366; }
+.entry-content tr:nth-child(even) { background-color: #f8f9fa; }
+.entry-content td { padding: 7px; border-right: 1px solid #626366; }
+.entry-content td:last-child { border-right: 0; }
+.entry-content th { background-color: #f8f9fa; border-bottom: 1px solid #626366; border-right: 1px solid #626366; }
+.entry-content th:last-child { border-right: 0; }
+.entry-content blockquote { margin: 0 0 1.5em 0.75em; padding: 0 0 0 0.75em; border-left: 3px solid #2980b9; font-style: italic; color: #9fa6b4; }
+.entry-content dd { margin-left: 0; font-size: 0.9em; color: #787878; margin-bottom: 1.5em; }
+.entry-content img { margin: 0 0 1.5em 0; max-width: 100%; height: auto; }
+.entry-content .size-auto, .entry-content .size-full, .entry-content .size-large, .entry-content .size-medium, .entry-content .size-thumbnail { max-width: 100%; height: auto; }
+.entry-content pre { background: #323944; color: #f8f9fa; font-size: 0.9em; padding: 1.5em; margin: 0 0 1.5em; border-radius: 3px; }
+
+/* end .entry-content */
+.wp-caption { max-width: 100%; background: #eee; padding: 5px; /* images inside wp-caption */ }
+.wp-caption img { max-width: 100%; margin-bottom: 0; width: 100%; }
+.wp-caption p.wp-caption-text { font-size: 0.85em; margin: 4px 0 7px; text-align: center; }
+
+/* end .wp-caption */
+/* image gallery styles */
+/* end .gallery */
+/* gallery caption styles */
+.tags { margin: 0; }
+
+
+blockquote {font-size:11pt;}
+/******************************************************************
+PAGE NAVI STYLES
+******************************************************************/
+.pagination, .wp-prev-next { margin: 1.5em 0; }
+
+.pagination { text-align: center; }
+.pagination ul { display: inline-block; white-space: nowrap; padding: 0; clear: both; border-radius: 3px; }
+.pagination li { padding: 0; margin: 0; float: left; display: inline; overflow: hidden; border-right: 1px solid #9fa6b4; }
+.pagination a, .pagination span { margin: 0; text-decoration: none; padding: 0; line-height: 1em; font-size: 1em; font-weight: normal; padding: 0.75em; min-width: 1em; display: block; color: #f9bf12; }
+.pagination a:hover, .pagination a:focus, .pagination span:hover, .pagination span:focus { background-color: #f9bf12; color: white; }
+.pagination .current { cursor: default; color: #9fa6b4; }
+.pagination .current:hover, .pagination .current:focus { background-color: transparent; color: #5c6b80; }
+
+/* end .bones_page_navi */
+/* fallback previous & next links */
+.wp-prev-next .prev-link { float: left; }
+.wp-prev-next .next-link { float: right; }
+
+/* end .wp-prev-next */
+/******************************************************************
+COMMENT STYLES
+******************************************************************/
+/* h3 comment title */
+#comments-title { padding: 0.75em; margin: 0; border-top: 1px solid #f8f9fa; /* number of comments span */ }
+
+.commentlist { margin: 0; list-style-type: none; }
+
+.comment { position: relative; clear: both; overflow: hidden; padding: 1.5em; border-bottom: 1px solid #f8f9fa; /* vcard */ /* end .commentlist .vcard */ /* end children */ /* general comment classes */ }
+.comment .comment-author { padding: 7px; border: 0; }
+.comment .vcard { margin-left: 50px; }
+.comment .vcard cite.fn { font-weight: 700; font-style: normal; }
+.comment .vcard time { display: block; font-size: 0.9em; font-style: italic; }
+.comment .vcard time a { color: #9fa6b4; text-decoration: none; }
+.comment .vcard time a:hover { text-decoration: underline; }
+.comment .vcard .avatar { position: absolute; left: 16px; border-radius: 50%; }
+.comment:last-child { margin-bottom: 0; }
+.comment .children { margin: 0; /* variations */ /* change number for different depth */ }
+.comment[class*=depth-] { margin-top: 1.1em; }
+.comment.depth-1 { margin-left: 0; margin-top: 0; }
+.comment:not(.depth-1) { margin-top: 0; margin-left: 7px; padding: 7px; }
+.comment.odd { background-color: white; }
+.comment.even { background: #f8f9fa; }
+
+/* comment meta */
+/* comment content */
+.comment_content p { margin: 0.7335em 0 1.5em; font-size: 1em; line-height: 1.5em; }
+
+/* end .commentlist .comment_content */
+/* comment reply link */
+.comment-reply-link { font-size: 0.9em; float: right; }
+
+/* end .commentlist .comment-reply-link */
+/* edit comment link */
+.comment-edit-link { font-style: italic; margin: 0 7px; text-decoration: none; font-size: 0.9em; }
+
+/******************************************************************
+COMMENT FORM STYLES
+******************************************************************/
+.comment-respond { padding: 1.5em; border-top: 1px solid #f8f9fa; }
+
+#reply-title { margin: 0; }
+
+.logged-in-as { color: #9fa6b4; font-style: italic; margin: 0; }
+.logged-in-as a { color: #5c6b80; }
+
+.comment-form-comment { margin: 1.5em 0 0.75em; }
+
+.form-allowed-tags { padding: 1.5em; background-color: #f8f9fa; font-size: 0.9em; }
+
+/* comment submit button */
+#submit { float: right; font-size: 1em; }
+
+/* comment form title */
+#comment-form-title { margin: 0 0 1.1em; }
+
+/* cancel comment reply link */
+/* logged in comments */
+/* allowed tags */
+#allowed_tags { margin: 1.5em 10px 0.7335em 0; }
+
+/* no comments */
+.nocomments { margin: 0 20px 1.1em; }
+
+/*********************
+SIDEBARS & ASIDES
+*********************/
+.widget ul li { /* deep nesting */ }
+
+.no-widgets { background-color: white; padding: 1.5em; text-align: center; border: 1px solid #cccccc; border-radius: 2px; margin-bottom: 1.5em; }
+
+.sidebar {margin-bottom:25px;}
+.sidebar ul {list-style-type:none;padding-left:0;list-style-image:none;}
+
+.social-sidebar {display:none;}
+
+.downloads {background:#d0cbc5;padding:10px;}
+.downloads h1 {color:#fff;text-align:center;background:#bfb8b0;padding:50px 0;margin:0;width:100%;}
+.downloads ul {list-style-image:none;list-style-type:none;margin:35px 0 25px;font-size:10.5pt;line-height:1.1em;letter-spacing:0px;}
+.downloads ul li {margin-bottom:25px;}
+.downloads ul li a {color:#c77240;font-weight:bold;text-transform:uppercase;-webkit-transition: color .3s ease;-moz-transition: color .3s ease;-ms-transition: color .3s ease;-o-transition: color .3s ease;transition: color .3s ease;}
+.downloads ul li a:hover {color:#000;}
+.downloads ul .icon-keyboard_arrow_right {font-size:1.5em;position:relative;top:4px;}
+
+/*********************
+FOOTER STYLES
+*********************/
+.footer { clear: both; background-color: #363132; color: #f8f9fa; min-height: 50px; }
+
+/*
+if you checked out the link above:
+http://www.alistapart.com/articles/organizing-mobile/
+you'll want to style the footer nav
+a bit more in-depth. Remember to keep
+it simple because you'll have to
+override these styles for the desktop
+view.
+*/
+/* end .footer-links */
+/*********************
+LARGER MOBILE DEVICES
+This is for devices like the Galaxy Note or something that's
+larger than an iPhone but smaller than a tablet. Let's call them
+tweeners.
+*********************/
+@media only screen and (min-width: 481px) { /****************************************************************** Site Name: Author: Stylesheet: 481px and Up Stylesheet This stylesheet is loaded for larger devices. It's set to 481px because at 480px it would load on a landscaped iPhone. This isn't ideal because then you would be loading all those extra styles on that same mobile connection. A word of warning. This size COULD be a larger mobile device, so you still want to keep it pretty [...]
+ /* IMPORTANT NOTE ABOUT SASS 3.3 & UP You can't use @extend within media queries anymore, so just be aware that if you drop them in here, they won't work. */
+ /********************* NAVIGATION STYLES ********************/
+ /* .menu is clearfixed inside mixins.scss */
+ .menu { /* end .menu ul */ }
+ .menu ul { /* end .menu ul li */ /* highlight current page */ /* end current highlighters */ }
+ .menu ul li { /*
+plan your menus and drop-downs wisely.
+*/ }
+ .menu ul li a { /*
+you can use hover styles here even though this size
+has the possibility of being a mobile device.
+*/ }
+ /* end .menu */
+ /********************* POSTS & CONTENT STYLES ********************/
+ #user-stories .table-cell { width: auto; display: table-cell; text-align: left; }
+ #user-stories .quote-man { text-align: center; width: 200px; }
+ .arrow { margin: 50px 0 0; width: 85%; height: 130px; background-color: #c97644; position: relative; }
+ .arrow p { margin: 20px 25px 20px 25px; font-size: 14pt; text-align: left; line-height: 1.2em; }
+ .arrow:after { content: ''; position: absolute; top: 0px; left: 100%; width: 0; height: 0; border: 65px solid transparent; border-left: 55px solid #f9bf12; }
+ /* entry content */
+ .entry-content { /* at this larger size, we can start to align images */ }
+ .entry-content .alignleft, .entry-content img.alignleft { margin-right: 1.5em; display: inline; float: left; }
+ .entry-content .alignright, .entry-content img.alignright { margin-left: 1.5em; display: inline; float: right; }
+ .entry-content .aligncenter, .entry-content img.aligncenter { margin-right: auto; margin-left: auto; display: block; clear: both; }
+ /* end .entry-content */
+ /********************* FOOTER STYLES ********************/
+ /* check your menus here. do they look good? do they need tweaking? */
+ /* end .footer-links */ }
+/*********************
+TABLET & SMALLER LAPTOPS
+This is the average viewing window. So Desktops, Laptops, and
+in general anyone not viewing on a mobile device. Here's where
+you can add resource intensive styles.
+*********************/
+@media only screen and (min-width: 768px) { /****************************************************************** Site Name: Author: Stylesheet: Tablet & Small Desktop Stylesheet Here's where you can start getting into the good stuff. This size will work on iPads, other tablets, and desktops. So you can start working with more styles, background images, and other resources. You'll also notice the grid starts to come into play. Have fun! ************************************************** [...]
+ /********************* GENERAL STYLES ********************/
+ /********************* LAYOUT & GRID STYLES ********************/
+ .wrap { width: 760px; }
+ .cd-top { right: 20px; bottom: 20px; }
+ .social-sidebar {display:block;position: fixed;width: 50px;right: 0;top: 50%;margin-top: -100px;background: #c97644;z-index: 100;padding: 5px 0 5px 10px;opacity: 0.5;transition: width .2s linear;-moz-transition: width .2s linear;-webkit-transition: width .2s linear;}
+ .social-sidebar a {color:#fff;font-size:2em;display:block;}
+ .social-sidebar a:hover {color:#a04209;}
+ .social-sidebar:hover {opacity:1;width:60px;}
+ /********************* HEADER STYLES ********************/
+
+ #masthead .wrap { text-align: left; position:relative;min-height:550px;}
+ .contribute {position:absolute;bottom:0;right:0;max-width:500px;color:#fff;text-align:center;}
+ #masthead h1 { text-align: left; margin: 0; }
+ #masthead p { text-align: left; }
+ .page #masthead .wrap {min-height:250px;}
+ .page #masthead h1 {text-align:center;margin:0 auto;}
+
+ /********************* NAVIGATION STYLES ********************/
+ .nav { border: 0; float: right; margin-top: 35px; /* end .menu ul li */ /* highlight current page */ /* end current highlighters */ }
+ .nav ul { background: #e8e5e0; margin-top: 0; }
+ .nav li { float: left; position: relative; /*
+plan your menus and drop-downs wisely.
+*/ /* showing sub-menus */ }
+ .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.5em; /*
+you can use hover styles here even though this size
+has the possibility of being a mobile device.
+*/ }
+ .nav li a:hover, .nav li a:focus { color: #c97644; }
+ .nav li.active > a {color:#c97644;}
+ .nav li ul.sub-menu, .nav li ul.children { margin-top: 0; position: absolute; visibility: hidden;opacity:0; z-index: 8999;padding-left:0; -webkit-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-moz-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-ms-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s; -o-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-i [...]
+
+ .nav li ul.sub-menu li a, .nav li ul.children li a { float:none;padding-left: 10px; border-right: 0; display: block; width: 235px; border-bottom: 1px solid #ccc; }
+ .nav li ul.sub-menu li a:hover, .nav li ul.children li a:hover {color:#c97644;}
+ .nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
+ .nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
+ .nav li:hover > ul { top: auto; visibility: visible; opacity:1;-moz-transform: translateY(0%);-webkit-transform: translateY(0%); -o-transform: translateY(0%);-ms-transform: translateY(0%); transform: translateY(0%); -webkit-transition-delay: 0s, 0s, 0.3s;-moz-transition-delay: 0s, 0s, 0.3s;-o-transition-delay: 0s, 0s, 0.3s;transition-delay: 0s, 0s, 0.3s; /* this removes the transition delay so the menu will be visible while the other styles transition */}
+ /* end .nav */
+ /********************* CONTENT ********************/
+ #how-it-works { padding: 100px 0; text-align: left; }
+ #how-it-works img { display: block; margin: 0 auto; }
+ #key-features .d-1of2:nth-of-type(2n+1) { clear: both; }
+ #key-features .d-1of2 p { margin-right: 35px; }
+ #use-case .table { padding: 25px 0 25px 50px; }
+ #use-case .table:first-of-type { padding-top: 0; }
+ #use-case .table:last-of-type { padding-bottom: 0; }
+ #use-case .left img { margin-bottom: 0; padding-right: 25px; }
+ #use-case h3 {margin: 10px 0 75px;}
+ .quotes .table-cell {display:table-cell;text-align:center;}
.table-cell.quote-man {padding-right:35px;text-align:center;}
+ .table-cell.quote-man img {text-align:center;}
+ .arrow { height: 80px; }
+ .arrow p { margin: 20px 85px 20px 25px; }
+ .arrow:after { border: 40px solid transparent; border-left: 40px solid #f9bf12; }
+ .hentry { margin-right: 50px; }
+
+ /********************* SIDEBARS & ASIDES ********************/
+ .sidebar { margin-top: 0; }
+ .widgettitle { border-bottom: 2px solid #444; margin-bottom: 0.75em; }
+ .widget { padding: 0 10px; margin: 2.2em 0; }
+ .widget ul li { margin-bottom: 0.75em; /* deep nesting */ }
+ .widget ul li ul { margin-top: 0.75em; padding-left: 1em; }
+
+ /********************* FOOTER STYLES ********************/
+ /* you'll probably need to do quite a bit of overriding here if you styled them for mobile. Make sure to double check these! */
+ .footer-links ul li { /*
+be careful with the depth of your menus.
+it's very rare to have multi-depth menus in
+the footer.
+*/ }
+.y-btn {display:inline-block;margin:0;}
+/*.y-btn:first-of-type {margin-right:15px;}*/
+ /* end .footer-links */ }
+/*********************
+DESKTOP
+This is the average viewing window. So Desktops, Laptops, and
+in general anyone not viewing on a mobile device. Here's where
+you can add resource intensive styles.
+*********************/
+@media only screen and (min-width: 1030px) { /****************************************************************** Site Name: Author: Stylesheet: Desktop Stylsheet This is the desktop size. It's larger than an iPad so it will only be seen on the Desktop. *****************************************************************/
+ #logo { float: left; text-align: left; }
+ .wrap, .page .wrap.with-sidebar { width: 1040px; }
+ .cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
+ .nav li a { padding: .75em 1.6em; }
+ .nav li:last-child a {padding-right:0;}
+ img.oniguy { margin-top: 75px; }
+ .page #masthead .wrap {min-height:360px;display: flex; justify-content: flex-end; align-items: center; align-content: flex-end;text-align:right;}
+ #and { display: table; border-collapse: separate; width: 100%; }
+ #and .and-row { display: table-row; }
+ #and .and-cell { display: table-cell; vertical-align: middle; }
+ #and p { margin: 0; }
+ #and img { margin-right: 35px; }
+ #use-case .table:last-of-type { padding-bottom: 125px; }
+ .arrow { height: 80px; }
+ .arrow p { margin: 30px 60px 20px 25px; }
+ .arrow:after { border: 40px solid transparent; border-left: 40px solid #c97644; }
+
+ .page .wrap.with-sidebar {display:flex;}
+ .page .downloads {margin-left:50px;} }
+
+/*********************
+LARGE VIEWING SIZE
+This is for the larger monitors and possibly full screen viewers.
+*********************/
+@media only screen and (min-width: 1240px) {
+ #user-stories .wrap {width:1140px;}
+}
+/*********************
+RETINA (2x RESOLUTION DEVICES)
+This applies to the retina iPhone (4s) and iPad (2,3) along with
+other displays with a 2x resolution. You can also create a media
+query for retina AND a certain size if you want. Go Nuts.
+*********************/
+@media only screen and (-webkit-min-device-pixel-ratio: 1.5), only screen and (min--moz-device-pixel-ratio: 1.5), only screen and (min-device-pixel-ratio: 1.5) { /****************************************************************** Site Name: Author: Stylesheet: Retina Screens & Devices Stylesheet When handling retina screens you need to make adjustments, especially if you're not using font icons. Here you can add them in one neat place. *********************************************** [...]
+ /* EXAMPLE Let's say you have an image and you need to make sure it looks ok on retina screens. Let's say we have an icon which dimension are 24px x 24px. In your regular stylesheets, it would look something like this: .icon { width: 24px; height: 24px; background: url(../css/img/test.png) no-repeat; } For retina screens, we have to make some adjustments, so that image doesn't look blurry. So, taking into account the image above and the dimensions, this is what we would put in [...]
+/*********************
+PRINT STYLESHEET
+Feel free to customize this. Remember to add things that won't make
+sense to print at the bottom. Things like nav, ads, and forms should
+be set to display none.
+*********************/
+@media print { /****************************************************************** Site Name: Author: Stylesheet: Print Stylesheet This is the print stylesheet. There's probably not a lot of reasons to edit this stylesheet. If you want to though, go for it. *****************************************************************/
+ * { background: transparent !important; color: black !important; text-shadow: none !important; filter: none !important; -ms-filter: none !important; }
+ a, a:visited { color: #444 !important; text-decoration: underline; }
+ a:after, a:visited:after { content: " (" attr(href) ")"; }
+ a abbr[title]:after, a:visited abbr[title]:after { content: " (" attr(title) ")"; }
+ .ir a:after, a[href^="javascript:"]:after, a[href^="#"]:after { content: ""; }
+ pre, blockquote { border: 1px solid #999; page-break-inside: avoid; }
+ thead { display: table-header-group; }
+ tr, img { page-break-inside: avoid; }
+ img { max-width: 100% !important; }
+ @page { margin: 0.5cm; }
+ p, h2, h3 { orphans: 3; widows: 3; }
+ h2, h3 { page-break-after: avoid; }
+ .sidebar, .page-navigation, .wp-prev-next, .respond-form, nav { display: none; } }
diff --git a/library/fonts/icomoon.eot b/library/fonts/icomoon.eot
new file mode 100755
index 0000000..2b66be3
Binary files /dev/null and b/library/fonts/icomoon.eot differ
diff --git a/library/fonts/icomoon.svg b/library/fonts/icomoon.svg
new file mode 100755
index 0000000..e8e5364
--- /dev/null
+++ b/library/fonts/icomoon.svg
@@ -0,0 +1,14 @@
+<?xml version="1.0" standalone="no"?>
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd" >
+<svg xmlns="http://www.w3.org/2000/svg">
+<metadata>Generated by IcoMoon</metadata>
+<defs>
+<font id="icomoon" horiz-adv-x="1024">
+<font-face units-per-em="1024" ascent="960" descent="-64" />
+<missing-glyph horiz-adv-x="1024" />
+<glyph unicode=" " horiz-adv-x="512" d="" />
+<glyph unicode="" glyph-name="keyboard_arrow_right" d="M366 240.667l196 196-196 196 60 60 256-256-256-256z" />
+<glyph unicode="" glyph-name="twitter" d="M1024 733.6c-37.6-16.8-78.2-28-120.6-33 43.4 26 76.6 67.2 92.4 116.2-40.6-24-85.6-41.6-133.4-51-38.4 40.8-93 66.2-153.4 66.2-116 0-210-94-210-210 0-16.4 1.8-32.4 5.4-47.8-174.6 8.8-329.4 92.4-433 219.6-18-31-28.4-67.2-28.4-105.6 0-72.8 37-137.2 93.4-174.8-34.4 1-66.8 10.6-95.2 26.2 0-0.8 0-1.8 0-2.6 0-101.8 72.4-186.8 168.6-206-17.6-4.8-36.2-7.4-55.4-7.4-13.6 0-26.6 1.4-39.6 3.8 26.8-83.4 104.4-144.2 196.2-146-72-56.4-162.4-90-261-90-17 0 [...]
+<glyph unicode="" glyph-name="envelope" d="M1024 545.143v-453.714c0-50.286-41.143-91.429-91.429-91.429h-841.143c-50.286 0-91.429 41.143-91.429 91.429v453.714c17.143-18.857 36.571-35.429 57.714-49.714 94.857-64.571 190.857-129.143 284-197.143 48-35.429 107.429-78.857 169.714-78.857h1.143c62.286 0 121.714 43.429 169.714 78.857 93.143 67.429 189.143 132.571 284.571 197.143 20.571 14.286 40 30.857 57.143 49.714zM1024 713.143c0-64-47.429-121.714-97.714-156.571-89.143-61.714-178.857-12 [...]
+<glyph unicode="" glyph-name="slack" horiz-adv-x="951" d="M868 507.428c46.857 0 82.857-34.286 82.857-81.143 0-36.571-18.857-62.286-53.143-74.286l-98.286-33.714 32-95.429c2.857-8.571 4-17.714 4-26.857 0-45.143-36.571-82.857-81.714-82.857-36 0-68 22.286-79.429 56.571l-31.429 94.286-177.143-60.571 31.429-93.714c2.857-8.571 4.571-17.714 4.571-26.857 0-44.571-36.571-82.857-82.286-82.857-36 0-67.429 22.286-78.857 56.571l-31.429 93.143-87.429-30.286c-9.143-2.857-18.857-5.143-28.571-5.14 [...]
+</font></defs></svg>
\ No newline at end of file
diff --git a/library/fonts/icomoon.ttf b/library/fonts/icomoon.ttf
new file mode 100755
index 0000000..3da8f63
Binary files /dev/null and b/library/fonts/icomoon.ttf differ
diff --git a/library/fonts/icomoon.woff b/library/fonts/icomoon.woff
new file mode 100755
index 0000000..ef7be06
Binary files /dev/null and b/library/fonts/icomoon.woff differ
diff --git a/library/images/FloCon2015.png b/library/images/FloCon2015.png
new file mode 100755
index 0000000..5ce929d
Binary files /dev/null and b/library/images/FloCon2015.png differ
diff --git a/library/images/ONI_Architecture-Diagram_1300_v4.png b/library/images/ONI_Architecture-Diagram_1300_v4.png
new file mode 100755
index 0000000..4034c7d
Binary files /dev/null and b/library/images/ONI_Architecture-Diagram_1300_v4.png differ
diff --git a/library/images/SPOT_Collabration-Icon_v2.png b/library/images/SPOT_Collabration-Icon_v2.png
new file mode 100755
index 0000000..6e42c14
Binary files /dev/null and b/library/images/SPOT_Collabration-Icon_v2.png differ
diff --git a/library/images/SPOT_OpenDataModel-Icon_v1.png b/library/images/SPOT_OpenDataModel-Icon_v1.png
new file mode 100755
index 0000000..a7556df
Binary files /dev/null and b/library/images/SPOT_OpenDataModel-Icon_v1.png differ
diff --git a/library/images/add-to-slack.png b/library/images/add-to-slack.png
new file mode 100755
index 0000000..9f15e5e
Binary files /dev/null and b/library/images/add-to-slack.png differ
diff --git a/library/images/advantages-1.png b/library/images/advantages-1.png
new file mode 100755
index 0000000..cf6e381
Binary files /dev/null and b/library/images/advantages-1.png differ
diff --git a/library/images/and.png b/library/images/and.png
new file mode 100755
index 0000000..e292648
Binary files /dev/null and b/library/images/and.png differ
diff --git a/library/images/apache-incubator.png b/library/images/apache-incubator.png
new file mode 100755
index 0000000..0b44446
Binary files /dev/null and b/library/images/apache-incubator.png differ
diff --git a/library/images/apple-touch-icon.png b/library/images/apple-touch-icon.png
new file mode 100755
index 0000000..b561378
Binary files /dev/null and b/library/images/apple-touch-icon.png differ
diff --git a/library/images/bullet.png b/library/images/bullet.png
new file mode 100755
index 0000000..df56eae
Binary files /dev/null and b/library/images/bullet.png differ
diff --git a/library/images/cd-top-arrow.svg b/library/images/cd-top-arrow.svg
new file mode 100755
index 0000000..5468d98
--- /dev/null
+++ b/library/images/cd-top-arrow.svg
@@ -0,0 +1,7 @@
+<?xml version="1.0" encoding="utf-8"?>
+<!-- Generator: Adobe Illustrator 17.1.0, SVG Export Plug-In . SVG Version: 6.00 Build 0) -->
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd">
+<svg version="1.1" id="Layer_1" xmlns="http://www.w3.org/2000/svg" xmlns:xlink="http://www.w3.org/1999/xlink" x="0px" y="0px"
+ width="16px" height="16px" viewBox="0 0 16 16" enable-background="new 0 0 16 16" xml:space="preserve">
+<polygon fill="#FFFFFF" points="8,2.8 16,10.7 13.6,13.1 8.1,7.6 2.5,13.2 0,10.7 "/>
+</svg>
diff --git a/library/images/community/centrify.png b/library/images/community/centrify.png
new file mode 100755
index 0000000..f88d2a5
Binary files /dev/null and b/library/images/community/centrify.png differ
diff --git a/library/images/community/cloudera.png b/library/images/community/cloudera.png
new file mode 100755
index 0000000..318f498
Binary files /dev/null and b/library/images/community/cloudera.png differ
diff --git a/library/images/community/cloudwick.png b/library/images/community/cloudwick.png
new file mode 100755
index 0000000..5ec673d
Binary files /dev/null and b/library/images/community/cloudwick.png differ
diff --git a/library/images/community/cybraics.png b/library/images/community/cybraics.png
new file mode 100755
index 0000000..be3aba4
Binary files /dev/null and b/library/images/community/cybraics.png differ
diff --git a/library/images/community/ebay.png b/library/images/community/ebay.png
new file mode 100755
index 0000000..2a1a08f
Binary files /dev/null and b/library/images/community/ebay.png differ
diff --git a/library/images/community/endgame.png b/library/images/community/endgame.png
new file mode 100755
index 0000000..64c8daf
Binary files /dev/null and b/library/images/community/endgame.png differ
diff --git a/library/images/community/intel.png b/library/images/community/intel.png
new file mode 100755
index 0000000..a5cb98a
Binary files /dev/null and b/library/images/community/intel.png differ
diff --git a/library/images/community/jask.png b/library/images/community/jask.png
new file mode 100755
index 0000000..632a1b2
Binary files /dev/null and b/library/images/community/jask.png differ
diff --git a/library/images/community/rich-it.png b/library/images/community/rich-it.png
new file mode 100755
index 0000000..378c6c3
Binary files /dev/null and b/library/images/community/rich-it.png differ
diff --git a/library/images/community/semantix.png b/library/images/community/semantix.png
new file mode 100755
index 0000000..2fe1a84
Binary files /dev/null and b/library/images/community/semantix.png differ
diff --git a/library/images/community/webroot.png b/library/images/community/webroot.png
new file mode 100755
index 0000000..e8d19b7
Binary files /dev/null and b/library/images/community/webroot.png differ
diff --git a/library/images/connects.png b/library/images/connects.png
new file mode 100755
index 0000000..dc63531
Binary files /dev/null and b/library/images/connects.png differ
diff --git a/library/images/details.png b/library/images/details.png
new file mode 100755
index 0000000..8e6c11a
Binary files /dev/null and b/library/images/details.png differ
diff --git a/library/images/how-it-works.png b/library/images/how-it-works.png
new file mode 100755
index 0000000..c0b931d
Binary files /dev/null and b/library/images/how-it-works.png differ
diff --git a/library/images/iPython-1.png b/library/images/iPython-1.png
new file mode 100755
index 0000000..80b8ea7
Binary files /dev/null and b/library/images/iPython-1.png differ
diff --git a/library/images/individual-push.png b/library/images/individual-push.png
new file mode 100755
index 0000000..3da8241
Binary files /dev/null and b/library/images/individual-push.png differ
diff --git a/library/images/ingest-summary.png b/library/images/ingest-summary.png
new file mode 100755
index 0000000..d715485
Binary files /dev/null and b/library/images/ingest-summary.png differ
diff --git a/library/images/ingestion.png b/library/images/ingestion.png
new file mode 100755
index 0000000..fa7914e
Binary files /dev/null and b/library/images/ingestion.png differ
diff --git a/library/images/key_features_bg.jpg b/library/images/key_features_bg.jpg
new file mode 100755
index 0000000..68b0a42
Binary files /dev/null and b/library/images/key_features_bg.jpg differ
diff --git a/library/images/logo.png b/library/images/logo.png
new file mode 100755
index 0000000..1bf9f68
Binary files /dev/null and b/library/images/logo.png differ
diff --git a/library/images/machine-learning.png b/library/images/machine-learning.png
new file mode 100755
index 0000000..188e6e0
Binary files /dev/null and b/library/images/machine-learning.png differ
diff --git a/library/images/magnify-icon.png b/library/images/magnify-icon.png
new file mode 100755
index 0000000..b2e7b23
Binary files /dev/null and b/library/images/magnify-icon.png differ
diff --git a/library/images/masthead-bg.jpg b/library/images/masthead-bg.jpg
new file mode 100755
index 0000000..c5179e2
Binary files /dev/null and b/library/images/masthead-bg.jpg differ
diff --git a/library/images/masthead-bg.png b/library/images/masthead-bg.png
new file mode 100755
index 0000000..afcf7be
Binary files /dev/null and b/library/images/masthead-bg.png differ
diff --git a/library/images/network.png b/library/images/network.png
new file mode 100755
index 0000000..cc2321b
Binary files /dev/null and b/library/images/network.png differ
diff --git a/library/images/not needed/FloCon2015-300x225.png b/library/images/not needed/FloCon2015-300x225.png
new file mode 100755
index 0000000..5548349
Binary files /dev/null and b/library/images/not needed/FloCon2015-300x225.png differ
diff --git a/library/images/not needed/FloCon2015-768x576.png b/library/images/not needed/FloCon2015-768x576.png
new file mode 100755
index 0000000..d7b9253
Binary files /dev/null and b/library/images/not needed/FloCon2015-768x576.png differ
diff --git a/library/images/not needed/ONI_Architecture-Diagram_1300_v4-1024x532.png b/library/images/not needed/ONI_Architecture-Diagram_1300_v4-1024x532.png
new file mode 100755
index 0000000..89b99fd
Binary files /dev/null and b/library/images/not needed/ONI_Architecture-Diagram_1300_v4-1024x532.png differ
diff --git a/library/images/not needed/ONI_Architecture-Diagram_1300_v4-300x156.png b/library/images/not needed/ONI_Architecture-Diagram_1300_v4-300x156.png
new file mode 100755
index 0000000..07a51de
Binary files /dev/null and b/library/images/not needed/ONI_Architecture-Diagram_1300_v4-300x156.png differ
diff --git a/library/images/not needed/ONI_Architecture-Diagram_1300_v4-768x399.png b/library/images/not needed/ONI_Architecture-Diagram_1300_v4-768x399.png
new file mode 100755
index 0000000..41de6a4
Binary files /dev/null and b/library/images/not needed/ONI_Architecture-Diagram_1300_v4-768x399.png differ
diff --git a/library/images/not needed/ONI_Architecture-Diagram_1300_v4_old.png b/library/images/not needed/ONI_Architecture-Diagram_1300_v4_old.png
new file mode 100755
index 0000000..edb900a
Binary files /dev/null and b/library/images/not needed/ONI_Architecture-Diagram_1300_v4_old.png differ
diff --git a/library/images/not needed/advantages-1-300x136.png b/library/images/not needed/advantages-1-300x136.png
new file mode 100755
index 0000000..688810c
Binary files /dev/null and b/library/images/not needed/advantages-1-300x136.png differ
diff --git a/library/images/not needed/advantages-1-768x347.png b/library/images/not needed/advantages-1-768x347.png
new file mode 100755
index 0000000..8bb9ac1
Binary files /dev/null and b/library/images/not needed/advantages-1-768x347.png differ
diff --git a/library/images/not needed/iPython-1-300x89.png b/library/images/not needed/iPython-1-300x89.png
new file mode 100755
index 0000000..a17760c
Binary files /dev/null and b/library/images/not needed/iPython-1-300x89.png differ
diff --git a/library/images/notebook.png b/library/images/notebook.png
new file mode 100755
index 0000000..74f456d
Binary files /dev/null and b/library/images/notebook.png differ
diff --git a/library/images/odm.png b/library/images/odm.png
new file mode 100755
index 0000000..04c42b0
Binary files /dev/null and b/library/images/odm.png differ
diff --git a/library/images/quote-person.png b/library/images/quote-person.png
new file mode 100755
index 0000000..1fef64d
Binary files /dev/null and b/library/images/quote-person.png differ
diff --git a/library/images/quotes.png b/library/images/quotes.png
new file mode 100755
index 0000000..05c91ab
Binary files /dev/null and b/library/images/quotes.png differ
diff --git a/library/images/search.png b/library/images/search.png
new file mode 100755
index 0000000..985e83e
Binary files /dev/null and b/library/images/search.png differ
diff --git a/library/images/spot470.png b/library/images/spot470.png
new file mode 100755
index 0000000..ee85398
Binary files /dev/null and b/library/images/spot470.png differ
diff --git a/library/images/storyboard-icon.png b/library/images/storyboard-icon.png
new file mode 100755
index 0000000..2ea1e01
Binary files /dev/null and b/library/images/storyboard-icon.png differ
diff --git a/library/images/suspicious.png b/library/images/suspicious.png
new file mode 100755
index 0000000..b6714f5
Binary files /dev/null and b/library/images/suspicious.png differ
diff --git a/library/images/threat-icon.png b/library/images/threat-icon.png
new file mode 100755
index 0000000..7c14002
Binary files /dev/null and b/library/images/threat-icon.png differ
diff --git a/library/images/topic-branching.png b/library/images/topic-branching.png
new file mode 100755
index 0000000..5778dba
Binary files /dev/null and b/library/images/topic-branching.png differ
diff --git a/library/images/win8-tile-icon.png b/library/images/win8-tile-icon.png
new file mode 100755
index 0000000..2392bed
Binary files /dev/null and b/library/images/win8-tile-icon.png differ
diff --git a/library/js/jquery-migrate.min.js b/library/js/jquery-migrate.min.js
new file mode 100755
index 0000000..2e84fcb
--- /dev/null
+++ b/library/js/jquery-migrate.min.js
@@ -0,0 +1,2 @@
+/*! jQuery Migrate v1.4.1 | (c) jQuery Foundation and other contributors | jquery.org/license */
+"undefined"==typeof jQuery.migrateMute&&(jQuery.migrateMute=!0),function(a,b,c){function d(c){var d=b.console;f[c]||(f[c]=!0,a.migrateWarnings.push(c),d&&d.warn&&!a.migrateMute&&(d.warn("JQMIGRATE: "+c),a.migrateTrace&&d.trace&&d.trace()))}function e(b,c,e,f){if(Object.defineProperty)try{return void Object.defineProperty(b,c,{configurable:!0,enumerable:!0,get:function(){return d(f),e},set:function(a){d(f),e=a}})}catch(g){}a._definePropertyBroken=!0,b[c]=e}a.migrateVersion="1.4.1";var f={ [...]
\ No newline at end of file
diff --git a/library/js/jquery.js b/library/js/jquery.js
new file mode 100755
index 0000000..292c720
--- /dev/null
+++ b/library/js/jquery.js
@@ -0,0 +1,6 @@
+/*! jQuery v1.12.4 | (c) jQuery Foundation | jquery.org/license */
+!function(a,b){"object"==typeof module&&"object"==typeof module.exports?module.exports=a.document?b(a,!0):function(a){if(!a.document)throw new Error("jQuery requires a window with a document");return b(a)}:b(a)}("undefined"!=typeof window?window:this,function(a,b){var c=[],d=a.document,e=c.slice,f=c.concat,g=c.push,h=c.indexOf,i={},j=i.toString,k=i.hasOwnProperty,l={},m="1.12.4",n=function(a,b){return new n.fn.init(a,b)},o=/^[\s\uFEFF\xA0]+|[\s\uFEFF\xA0]+$/g,p=/^-ms-/,q=/-([\da-z])/gi,r [...]
+}return c}function Q(a){var b;for(b in a)if(("data"!==b||!n.isEmptyObject(a[b]))&&"toJSON"!==b)return!1;return!0}function R(a,b,d,e){if(M(a)){var f,g,h=n.expando,i=a.nodeType,j=i?n.cache:a,k=i?a[h]:a[h]&&h;if(k&&j[k]&&(e||j[k].data)||void 0!==d||"string"!=typeof b)return k||(k=i?a[h]=c.pop()||n.guid++:h),j[k]||(j[k]=i?{}:{toJSON:n.noop}),"object"!=typeof b&&"function"!=typeof b||(e?j[k]=n.extend(j[k],b):j[k].data=n.extend(j[k].data,b)),g=j[k],e||(g.data||(g.data={}),g=g.data),void 0!==d& [...]
+marginLeft:0},function(){return a.getBoundingClientRect().left}):0))+"px":void 0}),n.each({margin:"",padding:"",border:"Width"},function(a,b){n.cssHooks[a+b]={expand:function(c){for(var d=0,e={},f="string"==typeof c?c.split(" "):[c];4>d;d++)e[a+V[d]+b]=f[d]||f[d-2]||f[0];return e}},Na.test(a)||(n.cssHooks[a+b].set=db)}),n.fn.extend({css:function(a,b){return Y(this,function(a,b,c){var d,e,f={},g=0;if(n.isArray(b)){for(d=Ra(a),e=b.length;e>g;g++)f[b[g]]=n.css(a,b[g],!1,d);return f}return v [...]
+padding:"inner"+a,content:b,"":"outer"+a},function(c,d){n.fn[d]=function(d,e){var f=arguments.length&&(c||"boolean"!=typeof d),g=c||(d===!0||e===!0?"margin":"border");return Y(this,function(b,c,d){var e;return n.isWindow(b)?b.document.documentElement["client"+a]:9===b.nodeType?(e=b.documentElement,Math.max(b.body["scroll"+a],e["scroll"+a],b.body["offset"+a],e["offset"+a],e["client"+a])):void 0===d?n.css(b,c,g):n.style(b,c,d,g)},b,f?d:void 0,f,null)}})}),n.fn.extend({bind:function(a,b,c){ [...]
+jQuery.noConflict();
diff --git a/library/js/jquery.meanmenu.js b/library/js/jquery.meanmenu.js
new file mode 100755
index 0000000..873d459
--- /dev/null
+++ b/library/js/jquery.meanmenu.js
@@ -0,0 +1,285 @@
+/*!
+* jQuery meanMenu v2.0.8
+* @Copyright (C) 2012-2014 Chris Wharton @ MeanThemes (https://github.com/meanthemes/meanMenu)
+*
+*/
+/*
+* This program is free software: you can redistribute it and/or modify
+* it under the terms of the GNU General Public License as published by
+* the Free Software Foundation, either version 3 of the License, or
+* (at your option) any later version.
+*
+* THIS SOFTWARE AND DOCUMENTATION IS PROVIDED "AS IS," AND COPYRIGHT
+* HOLDERS MAKE NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR IMPLIED,
+* INCLUDING BUT NOT LIMITED TO, WARRANTIES OF MERCHANTABILITY OR
+* FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE OF THE SOFTWARE
+* OR DOCUMENTATION WILL NOT INFRINGE ANY THIRD PARTY PATENTS,
+* COPYRIGHTS, TRADEMARKS OR OTHER RIGHTS.COPYRIGHT HOLDERS WILL NOT
+* BE LIABLE FOR ANY DIRECT, INDIRECT, SPECIAL OR CONSEQUENTIAL
+* DAMAGES ARISING OUT OF ANY USE OF THE SOFTWARE OR DOCUMENTATION.
+*
+* You should have received a copy of the GNU General Public License
+* along with this program. If not, see <http://gnu.org/licenses/>.
+*
+* Find more information at http://www.meanthemes.com/plugins/meanmenu/
+*
+*/
+(function ($) {
+ "use strict";
+ $.fn.meanmenu = function (options) {
+ var defaults = {
+ meanMenuTarget: jQuery(this), // Target the current HTML markup you wish to replace
+ meanMenuContainer: '#mobile-nav', // Choose where meanmenu will be placed within the HTML
+ meanMenuClose: "X", // single character you want to represent the close menu button
+ meanMenuCloseSize: "18px", // set font size of close button
+ meanMenuOpen: "<span /><span /><span />", // text/markup you want when menu is closed
+ meanRevealPosition: "right", // left right or center positions
+ meanRevealPositionDistance: "0", // Tweak the position of the menu
+ meanRevealColour: "", // override CSS colours for the reveal background
+ meanScreenWidth: "1030", // set the screen width you want meanmenu to kick in at
+ meanNavPush: "", // set a height here in px, em or % if you want to budge your layout now the navigation is missing.
+ meanShowChildren: true, // true to show children in the menu, false to hide them
+ meanExpandableChildren: true, // true to allow expand/collapse children
+ meanExpand: "+", // single character you want to represent the expand for ULs
+ meanContract: "-", // single character you want to represent the contract for ULs
+ meanRemoveAttrs: false, // true to remove classes and IDs, false to keep them
+ onePage: false, // set to true for one page sites
+ meanDisplay: "block", // override display method for table cell based layouts e.g. table-cell
+ removeElements: "" // set to hide page elements
+ };
+ options = $.extend(defaults, options);
+
+ // get browser width
+ var currentWidth = window.innerWidth || document.documentElement.clientWidth;
+
+ return this.each(function () {
+ var meanMenu = options.meanMenuTarget;
+ var meanContainer = options.meanMenuContainer;
+ var meanMenuClose = options.meanMenuClose;
+ var meanMenuCloseSize = options.meanMenuCloseSize;
+ var meanMenuOpen = options.meanMenuOpen;
+ var meanRevealPosition = options.meanRevealPosition;
+ var meanRevealPositionDistance = options.meanRevealPositionDistance;
+ var meanRevealColour = options.meanRevealColour;
+ var meanScreenWidth = options.meanScreenWidth;
+ var meanNavPush = options.meanNavPush;
+ var meanRevealClass = ".meanmenu-reveal";
+ var meanShowChildren = options.meanShowChildren;
+ var meanExpandableChildren = options.meanExpandableChildren;
+ var meanExpand = options.meanExpand;
+ var meanContract = options.meanContract;
+ var meanRemoveAttrs = options.meanRemoveAttrs;
+ var onePage = options.onePage;
+ var meanDisplay = options.meanDisplay;
+ var removeElements = options.removeElements;
+
+ //detect known mobile/tablet usage
+ var isMobile = false;
+ if ( (navigator.userAgent.match(/iPhone/i)) || (navigator.userAgent.match(/iPod/i)) || (navigator.userAgent.match(/iPad/i)) || (navigator.userAgent.match(/Android/i)) || (navigator.userAgent.match(/Blackberry/i)) || (navigator.userAgent.match(/Windows Phone/i)) ) {
+ isMobile = true;
+ }
+
+ if ( (navigator.userAgent.match(/MSIE 8/i)) || (navigator.userAgent.match(/MSIE 7/i)) ) {
+ // add scrollbar for IE7 & 8 to stop breaking resize function on small content sites
+ jQuery('html').css("overflow-y" , "scroll");
+ }
+
+ var meanRevealPos = "";
+ var meanCentered = function() {
+ if (meanRevealPosition === "center") {
+ var newWidth = window.innerWidth || document.documentElement.clientWidth;
+ var meanCenter = ( (newWidth/2)-22 )+"px";
+ meanRevealPos = "left:" + meanCenter + ";right:auto;";
+
+ if (!isMobile) {
+ jQuery('.meanmenu-reveal').css("left",meanCenter);
+ } else {
+ jQuery('.meanmenu-reveal').animate({
+ left: meanCenter
+ });
+ }
+ }
+ };
+
+ var menuOn = false;
+ var meanMenuExist = false;
+
+
+ if (meanRevealPosition === "right") {
+ meanRevealPos = "right:" + meanRevealPositionDistance + ";left:auto;";
+ }
+ if (meanRevealPosition === "left") {
+ meanRevealPos = "left:" + meanRevealPositionDistance + ";right:auto;";
+ }
+ // run center function
+ meanCentered();
+
+ // set all styles for mean-reveal
+ var $navreveal = "";
+
+ var meanInner = function() {
+ // get last class name
+ if (jQuery($navreveal).is(".meanmenu-reveal.meanclose")) {
+ $navreveal.html(meanMenuClose);
+ } else {
+ $navreveal.html(meanMenuOpen);
+ }
+ };
+
+ // re-instate original nav (and call this on window.width functions)
+ var meanOriginal = function() {
+ jQuery('.mean-bar,.mean-push').remove();
+ jQuery(meanContainer).removeClass("mean-container");
+ jQuery(meanMenu).css('display', meanDisplay);
+ menuOn = false;
+ meanMenuExist = false;
+ jQuery(removeElements).removeClass('mean-remove');
+ };
+
+ // navigation reveal
+ var showMeanMenu = function() {
+ var meanStyles = "background:"+meanRevealColour+";color:"+meanRevealColour+";"+meanRevealPos;
+ if (currentWidth <= meanScreenWidth) {
+ jQuery(removeElements).addClass('mean-remove');
+ meanMenuExist = true;
+ // add class to body so we don't need to worry about media queries here, all CSS is wrapped in '.mean-container'
+ jQuery(meanContainer).addClass("mean-container");
+ jQuery('.mean-container').prepend('<div class="mean-bar"><a href="#nav" class="meanmenu-reveal" style="'+meanStyles+'">Show Navigation</a><nav class="mean-nav"></nav></div>');
+
+ //push meanMenu navigation into .mean-nav
+ var meanMenuContents = jQuery(meanMenu).html();
+ jQuery('.mean-nav').html(meanMenuContents);
+
+ // remove all classes from EVERYTHING inside meanmenu nav
+ if(meanRemoveAttrs) {
+ jQuery('nav.mean-nav ul, nav.mean-nav ul *').each(function() {
+ // First check if this has mean-remove class
+ if (jQuery(this).is('.mean-remove')) {
+ jQuery(this).attr('class', 'mean-remove');
+ } else {
+ jQuery(this).removeAttr("class");
+ }
+ jQuery(this).removeAttr("id");
+ });
+ }
+
+ // push in a holder div (this can be used if removal of nav is causing layout issues)
+ jQuery(meanMenu).before('<div class="mean-push" />');
+ jQuery('.mean-push').css("margin-top",meanNavPush);
+
+ // hide current navigation and reveal mean nav link
+ jQuery(meanMenu).hide();
+ jQuery(".meanmenu-reveal").show();
+
+ // turn 'X' on or off
+ jQuery(meanRevealClass).html(meanMenuOpen);
+ $navreveal = jQuery(meanRevealClass);
+
+ //hide mean-nav ul
+ jQuery('.mean-nav ul').hide();
+
+ // hide sub nav
+ if(meanShowChildren) {
+ // allow expandable sub nav(s)
+ if(meanExpandableChildren){
+ jQuery('.mean-nav ul ul').each(function() {
+ if(jQuery(this).children().length){
+ jQuery(this,'li:first').parent().append('<a class="mean-expand" href="#" style="font-size: '+ meanMenuCloseSize +'">'+ meanExpand +'</a>');
+ }
+ });
+ jQuery('.mean-expand').on("click",function(e){
+ e.preventDefault();
+ if (jQuery(this).hasClass("mean-clicked")) {
+ jQuery(this).text(meanExpand);
+ jQuery(this).prev('ul').slideUp(300, function(){});
+ } else {
+ jQuery(this).text(meanContract);
+ jQuery(this).prev('ul').slideDown(300, function(){});
+ }
+ jQuery(this).toggleClass("mean-clicked");
+ });
+ } else {
+ jQuery('.mean-nav ul ul').show();
+ }
+ } else {
+ jQuery('.mean-nav ul ul').hide();
+ }
+
+ // add last class to tidy up borders
+ jQuery('.mean-nav ul li').last().addClass('mean-last');
+ $navreveal.removeClass("meanclose");
+ jQuery($navreveal).click(function(e){
+ e.preventDefault();
+ if( menuOn === false ) {
+ $navreveal.css("text-align", "center");
+ $navreveal.css("text-indent", "0");
+ $navreveal.css("font-size", meanMenuCloseSize);
+ jQuery('.mean-nav ul:first').slideDown();
+ menuOn = true;
+ } else {
+ jQuery('.mean-nav ul:first').slideUp();
+ menuOn = false;
+ }
+ $navreveal.toggleClass("meanclose");
+ meanInner();
+ jQuery(removeElements).addClass('mean-remove');
+ });
+
+ // for one page websites, reset all variables...
+ if ( onePage ) {
+ jQuery('.mean-nav ul > li > a:first-child').on( "click" , function () {
+ jQuery('.mean-nav ul:first').slideUp();
+ menuOn = false;
+ jQuery($navreveal).toggleClass("meanclose").html(meanMenuOpen);
+ });
+ }
+ } else {
+ meanOriginal();
+ }
+ };
+
+ if (!isMobile) {
+ // reset menu on resize above meanScreenWidth
+ jQuery(window).resize(function () {
+ currentWidth = window.innerWidth || document.documentElement.clientWidth;
+ if (currentWidth > meanScreenWidth) {
+ meanOriginal();
+ } else {
+ meanOriginal();
+ }
+ if (currentWidth <= meanScreenWidth) {
+ showMeanMenu();
+ meanCentered();
+ } else {
+ meanOriginal();
+ }
+ });
+ }
+
+ jQuery(window).resize(function () {
+ // get browser width
+ currentWidth = window.innerWidth || document.documentElement.clientWidth;
+
+ if (!isMobile) {
+ meanOriginal();
+ if (currentWidth <= meanScreenWidth) {
+ showMeanMenu();
+ meanCentered();
+ }
+ } else {
+ meanCentered();
+ if (currentWidth <= meanScreenWidth) {
+ if (meanMenuExist === false) {
+ showMeanMenu();
+ }
+ } else {
+ meanOriginal();
+ }
+ }
+ });
+
+ // run main menuMenu function on load
+ showMeanMenu();
+ });
+ };
+})(jQuery);
diff --git a/library/js/libs/modernizr.custom.min.js b/library/js/libs/modernizr.custom.min.js
new file mode 100755
index 0000000..89bb6c1
--- /dev/null
+++ b/library/js/libs/modernizr.custom.min.js
@@ -0,0 +1,4 @@
+/* Modernizr 2.6.2 (Custom Build) | MIT & BSD
+ * Build: http://modernizr.com/download/#-fontface-backgroundsize-borderimage-flexbox-hsla-multiplebgs-opacity-rgba-textshadow-cssanimations-csscolumns-generatedcontent-cssgradients-cssreflections-csstransforms-csstransforms3d-csstransitions-applicationcache-hashchange-history-audio-video-input-inputtypes-localstorage-websockets-geolocation-svg-svgclippaths-touch-webgl-shiv-mq-cssclasses-addtest-prefixed-teststyles-testprop-testallprops-hasevent-prefixes-domprefixes-css_mediaqueries-css_ [...]
+ */
+;window.Modernizr=function(a,b,c){function D(a){j.cssText=a}function E(a,b){return D(n.join(a+";")+(b||""))}function F(a,b){return typeof a===b}function G(a,b){return!!~(""+a).indexOf(b)}function H(a,b){for(var d in a){var e=a[d];if(!G(e,"-")&&j[e]!==c)return b=="pfx"?e:!0}return!1}function I(a,b,d){for(var e in a){var f=b[a[e]];if(f!==c)return d===!1?a[e]:F(f,"function")?f.bind(d||b):f}return!1}function J(a,b,c){var d=a.charAt(0).toUpperCase()+a.slice(1),e=(a+" "+p.join(d+" ")+d).split( [...]
\ No newline at end of file
diff --git a/library/js/scripts.js b/library/js/scripts.js
new file mode 100755
index 0000000..520d373
--- /dev/null
+++ b/library/js/scripts.js
@@ -0,0 +1,141 @@
+/*
+ * Bones Scripts File
+ * Author: Eddie Machado
+ *
+ * This file should contain any js scripts you want to add to the site.
+ * Instead of calling it in the header or throwing it inside wp_head()
+ * this file will be called automatically in the footer so as not to
+ * slow the page load.
+ *
+ * There are a lot of example functions and tools in here. If you don't
+ * need any of it, just remove it. They are meant to be helpers and are
+ * not required. It's your world baby, you can do whatever you want.
+*/
+
+
+/*
+ * Get Viewport Dimensions
+ * returns object with viewport dimensions to match css in width and height properties
+ * ( source: http://andylangton.co.uk/blog/development/get-viewport-size-width-and-height-javascript )
+*/
+function updateViewportDimensions() {
+ var w=window,d=document,e=d.documentElement,g=d.getElementsByTagName('body')[0],x=w.innerWidth||e.clientWidth||g.clientWidth,y=w.innerHeight||e.clientHeight||g.clientHeight;
+ return { width:x,height:y };
+}
+// setting the viewport width
+var viewport = updateViewportDimensions();
+
+
+/*
+ * Throttle Resize-triggered Events
+ * Wrap your actions in this function to throttle the frequency of firing them off, for better performance, esp. on mobile.
+ * ( source: http://stackoverflow.com/questions/2854407/javascript-jquery-window-resize-how-to-fire-after-the-resize-is-completed )
+*/
+var waitForFinalEvent = (function () {
+ var timers = {};
+ return function (callback, ms, uniqueId) {
+ if (!uniqueId) { uniqueId = "Don't call this twice without a uniqueId"; }
+ if (timers[uniqueId]) { clearTimeout (timers[uniqueId]); }
+ timers[uniqueId] = setTimeout(callback, ms);
+ };
+})();
+
+// how long to wait before deciding the resize has stopped, in ms. Around 50-100 should work ok.
+var timeToWaitForLast = 100;
+
+
+/*
+ * Here's an example so you can see how we're using the above function
+ *
+ * This is commented out so it won't work, but you can copy it and
+ * remove the comments.
+ *
+ *
+ *
+ * If we want to only do it on a certain page, we can setup checks so we do it
+ * as efficient as possible.
+ *
+ * if( typeof is_home === "undefined" ) var is_home = $('body').hasClass('home');
+ *
+ * This once checks to see if you're on the home page based on the body class
+ * We can then use that check to perform actions on the home page only
+ *
+ * When the window is resized, we perform this function
+ * $(window).resize(function () {
+ *
+ * // if we're on the home page, we wait the set amount (in function above) then fire the function
+ * if( is_home ) { waitForFinalEvent( function() {
+ *
+ * // update the viewport, in case the window size has changed
+ * viewport = updateViewportDimensions();
+ *
+ * // if we're above or equal to 768 fire this off
+ * if( viewport.width >= 768 ) {
+ * console.log('On home page and window sized to 768 width or more.');
+ * } else {
+ * // otherwise, let's do this instead
+ * console.log('Not on home page, or window sized to less than 768.');
+ * }
+ *
+ * }, timeToWaitForLast, "your-function-identifier-string"); }
+ * });
+ *
+ * Pretty cool huh? You can create functions like this to conditionally load
+ * content and other stuff dependent on the viewport.
+ * Remember that mobile devices and javascript aren't the best of friends.
+ * Keep it light and always make sure the larger viewports are doing the heavy lifting.
+ *
+*/
+
+/*
+ * We're going to swap out the gravatars.
+ * In the functions.php file, you can see we're not loading the gravatar
+ * images on mobile to save bandwidth. Once we hit an acceptable viewport
+ * then we can swap out those images since they are located in a data attribute.
+*/
+function loadGravatars() {
+ // set the viewport using the function above
+ viewport = updateViewportDimensions();
+ // if the viewport is tablet or larger, we load in the gravatars
+ if (viewport.width >= 768) {
+ jQuery('.comment img[data-gravatar]').each(function(){
+ jQuery(this).attr('src',jQuery(this).attr('data-gravatar'));
+ });
+ }
+} // end function
+
+
+/*
+ * Put all your regular jQuery in here.
+*/
+jQuery(document).ready(function($) {
+ jQuery('header nav').meanmenu();
+
+ // browser window scroll (in pixels) after which the "back to top" link is shown
+ var offset = 300,
+ //browser window scroll (in pixels) after which the "back to top" link opacity is reduced
+ offset_opacity = 1200,
+ //duration of the top scrolling animation (in ms)
+ scroll_top_duration = 700,
+ //grab the "back to top" link
+ $back_to_top = $('.cd-top');
+
+ //hide or show the "back to top" link
+ $(window).scroll(function(){
+ ( $(this).scrollTop() > offset ) ? $back_to_top.addClass('cd-is-visible') : $back_to_top.removeClass('cd-is-visible cd-fade-out');
+ if( $(this).scrollTop() > offset_opacity ) {
+ $back_to_top.addClass('cd-fade-out');
+ }
+ });
+
+ //smooth scroll to top
+ $back_to_top.on('click', function(event){
+ event.preventDefault();
+ $('body,html').animate({
+ scrollTop: 0 ,
+ }, scroll_top_duration
+ );
+ });
+
+
+}); /* end of as page load scripts */
diff --git a/library/pdf/Proposed_Apache-Spot_workflow.pdf b/library/pdf/Proposed_Apache-Spot_workflow.pdf
new file mode 100755
index 0000000..7248f67
Binary files /dev/null and b/library/pdf/Proposed_Apache-Spot_workflow.pdf differ
diff --git a/project-components/index.php b/project-components/index.php
new file mode 100755
index 0000000..e69de29
diff --git a/project-components/ingestion/index.php b/project-components/ingestion/index.php
new file mode 100755
index 0000000..6305506
--- /dev/null
+++ b/project-components/ingestion/index.php
@@ -0,0 +1,67 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "page";
+$pageTitle = "Ingestion - Apache Spot";
+$description = "";
+$currentPage = 'ingestion';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <!--
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all d-1of2 right-center">
+ <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
+ </div>
+ </div>
+ </div>-->
+
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Apache Spot Ingestion</h1>
+
+ <p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the dat [...]
+
+ <p><img src="../../library/images/ingestion.png" alt="" /></p>
+
+ <h3>Inside the Ingest</h3>
+
+ <h4><em>Spot-Collectors</em></h4>
+
+ <p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
+
+ <p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
+ <p>Once a file has been uploaded there two paths are available.</p>
+
+ <ol>
+ <li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
+ <li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
+ </ol>
+
+ <h4><em>Kafka</em></h4>
+
+ <p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
+
+ <h4><em>Spot Workers</em></h4>
+
+ <p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
+
+ <p>Currently there are two types of Spot Workers.</p>
+
+ <ol>
+ <li>Python workers use multithreading to process data with the defined parsers.</li>
+ <li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
+ </ol>
+
+ </div>
+ <!--<?php include '../../includes/download-sidebar.php';?>-->
+ </div>
+
+ </div>
+
+
+<?php include '../../includes/prefooter.php'; ?>
+<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/project-components/machine-learning/index.php b/project-components/machine-learning/index.php
new file mode 100755
index 0000000..72de1ed
--- /dev/null
+++ b/project-components/machine-learning/index.php
@@ -0,0 +1,47 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "page";
+$pageTitle = "Machine Learning - Apache Spot";
+$description = "";
+$currentPage = 'machine-learning';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <!--
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all d-1of2 right-center">
+ <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
+ </div>
+ </div>
+ </div>-->
+
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Apache Spot Machine Learning</h1>
+
+ <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
+
+ <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
+
+ <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
+
+ <p><img src="../../library/images/machine-learning.png" alt="" /></p>
+
+ <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
+
+ <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
+ </div>
+
+ <!--<?php include '../../includes/download-sidebar.php';?>-->
+
+ </div>
+
+ </div>
+
+
+<?php include '../../includes/prefooter.php'; ?>
+<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/project-components/open-data-models/index.php b/project-components/open-data-models/index.php
new file mode 100755
index 0000000..9b95d9f
--- /dev/null
+++ b/project-components/open-data-models/index.php
@@ -0,0 +1,60 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "page";
+$pageTitle = "Open Data Models - Apache Spot";
+$description = "";
+$currentPage = 'open-data-models';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <!--
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all d-1of2 right-center">
+ <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
+ </div>
+ </div>
+ </div>-->
+
+
+ <div id="content">
+
+ <div class="wrap cf with-sidebar"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Apache Spot Open Data Model</h1>
+
+ <p>Many organizations have built threat detection capabilities leveraging myriad vendor solutions. This approach leads to many silos of data corresponding to each vendor and often results in storing multiple copies of the same data, as each vendor’s capability operates independently from the others. There is no single vendor able to cost-effectively store and analyze all the data required to detect threats and facilitate incident investigations and remediation.</p>
+
+ <p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection mo [...]
+
+ <p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
+
+ <p>The Apache Spot ODM enables organizations to:</p>
+ <ul>
+ <li>Store one copy of the security telemetry data and apply UNLIMITED analytics
+ <ul>
+ <li>Leverage out-of-the-box analytics powered by machine learning to detect threats in DNS, Flow and Proxy data</li>
+ <li>Build custom analytics to your desired specification</li>
+ <li>Plug-in third-party vendor analytics that interoperate with the ODM</li>
+ </ul>
+ </li>
+ <li>Share and/or reuse threat detection models, algorithms, ingest pipelines, visualizations and analytics across the Apache Spot community, due to a common data model.</li>
+ <li>Leverage all your security telemetry data to establish the context needed to better detect threats
+ <ul>
+ <li>Security logs</li>
+ <li>User, endpoint and network entity data</li>
+ <li>Threat intelligence data</li>
+ </ul>
+ </li>
+ <li>Avoid “lock-in” to a specific technology and gain needed analytic flexibility resultant from a shared, open data model.</li>
+ </ul>
+ </div>
+
+ <!--<?php include '../../includes/download-sidebar.php';?>-->
+
+ </div>
+
+ </div>
+
+<?php include '../../includes/prefooter.php'; ?>
+<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/project-components/visualization/index.php b/project-components/visualization/index.php
new file mode 100755
index 0000000..cd6b0a7
--- /dev/null
+++ b/project-components/visualization/index.php
@@ -0,0 +1,79 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "page";
+$pageTitle = "Visualization - Apache Spot";
+$description = "";
+$currentPage = 'visualization';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <!--
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all d-1of2 right-center">
+ <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
+ </div>
+ </div>
+ </div>-->
+
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Visualization</h1>
+ <h3>Take advantage of Apache Spot's tools to perform further analysis over the suspicious activity detected by our machine learning algorithm</h3>
+
+ <h4>Suspicious</h4>
+
+ <p>Study <strong>suspicious</strong> network activity by looking at a list of security threats detected by Apache Spot's machine learning algorithm.</p>
+
+ <p><img src="../../library/images/suspicious.png" alt="" /></p>
+
+ <p>Have a nice view of your network, understand how devices interact with each other and easily spot threats while exploring a visual representation of suspicious activity.</p>
+
+ <p><img src="../../library/images/network.png" alt="" /></p>
+
+ <p>The following feature is powered by IPython notebooks which allows the users to switch back and forth from the 'easy mode' to the 'expert mode', where they can view and edit the code behind this panel via the web browser.</p>
+
+ <p>In the 'Notebook' panel, the form displayed is where the user can assign the level of risk for each connection and use that as feedback to train the Machine Learning model in future executions. Switching to the 'expert' mode, the user can adjust the criteria to filter the data, discarding results known to be non relevant to the analysis.</p>
+
+ <p><img src="../../library/images/notebook.png" alt="" /></p>
+
+ <p>As your investigation moves forward, get <strong>detailed</strong> information about a threat whenever you want to dig into an especific threat.</p>
+
+ <p><img src="../../library/images/details.png" alt="" /></p>
+
+ <h4>Threat Investigation</h4>
+
+ <p>The threat investigation panel represents the last step of analysis before displaying the storyboard. At this point, the security analysts can enter a custom review for a given threat to display.</p>
+
+ <h4>Storyboard</h4>
+
+ <p>Ready to present your findings? Go over your high risk security threats and request further information, making it easy for executives to undestand what is going on. Here is a list of some of the information you will get when your analyses comes to the end.</p>
+
+ <ul>
+ <li>Incident Progression</li>
+ <li>Impact Analysis</li>
+ <li>Geographic location</li>
+ <li>Incident Timeline</li>
+ </ul>
+
+ <h4>Ingest Summary</h4>
+
+ <p>Wondering about how much data have been ingested on your cluster? We provide a nice visualization which allows you to get this information.</p>
+
+ <p><img src="../../library/images/ingest-summary.png" alt="" /></p>
+
+ <p>The "scoring panel" as well as the "Threat investigation panel" are powered by Jupyter notebooks, <a href="https://jupyter-notebook-beginner-guide.readthedocs.io/en/latest/what_is_jupyter.html" target="_blank">(click here to learn more)</a>.</p>
+ </div>
+
+ <!--<?php include '../../includes/download-sidebar.php';?>-->
+
+ </div>
+
+ </div>
+
+
+<?php include '../../includes/prefooter.php'; ?>
+<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/tag/github/index.php b/tag/github/index.php
new file mode 100755
index 0000000..fb1611c
--- /dev/null
+++ b/tag/github/index.php
@@ -0,0 +1,57 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive tag";
+$pageTitle = "Github - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: github</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/tag/index.php b/tag/index.php
new file mode 100755
index 0000000..e69de29
diff --git a/tag/open-network-insight/index.php b/tag/open-network-insight/index.php
new file mode 100755
index 0000000..ad6965b
--- /dev/null
+++ b/tag/open-network-insight/index.php
@@ -0,0 +1,59 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive tag";
+$pageTitle = "Open Network Insight - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: open network insight</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/tag/open-source/index.php b/tag/open-source/index.php
new file mode 100755
index 0000000..b8e749f
--- /dev/null
+++ b/tag/open-source/index.php
@@ -0,0 +1,59 @@
+<?php include '../../includes/config.php'; ?>
+<?php
+$bodyclass = "archive tag";
+$pageTitle = "Open Source - Apache Spot";
+$description = "";
+$currentPage = 'blog';
+?>
+<?php include '../../includes/header.php'; ?>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: open source</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <?php include '../../includes/sidebar.php'; ?>
+
+ </div>
+
+ </div>
+
+ <?php include '../../includes/footer.php'; ?>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
[incubator-spot] 26/45: Adding the link to User mail list archieve
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 3d7c97c16ee9f9bf903021b9285a5c752b23d900
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Tue Apr 18 11:23:10 2017 -0500
Adding the link to User mail list archieve
---
community/index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/community/index.html b/community/index.html
index b24afca..8625ee0 100755
--- a/community/index.html
+++ b/community/index.html
@@ -123,7 +123,7 @@
<p>Get help using Spot or contribute to the project on our mailing lists or our chat room:</p>
<ul>
- <li><a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (archives) - for usage questions, help, and announcements.</li>
+ <li><a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Spot Slack channel</a> - where many Spot developers and users hang out to answer questions and chat.</li>
</ul>
[incubator-spot] 43/45: replaced 2018 copyright with 2019
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit eda98a46db5d971f4c68bb073f8e341791e52745
Author: Mark Schoeni <ma...@gmail.com>
AuthorDate: Fri Mar 29 22:14:00 2019 -0500
replaced 2018 copyright with 2019
- used page-massedit tool
---
2016/03/index.html | 2 +-
2016/08/index.html | 2 +-
2016/09/index.html | 2 +-
2016/10/index.html | 2 +-
2017/03/index.html | 2 +-
apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-product-architecture-overview/index.html | 2 +-
.../index.html | 2 +-
blog/index.html | 2 +-
blog/jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
category/cybersecurity/index.html | 2 +-
category/data-science/index.html | 2 +-
category/ipython-notebooks/index.html | 2 +-
category/security-analytics/index.html | 2 +-
category/threat-analysis-tools/index.html | 2 +-
category/uncategorized/index.html | 2 +-
community/committers/index.html | 2 +-
community/contribute/index.html | 2 +-
community/index.html | 2 +-
contribute/index.html | 2 +-
download/index.html | 2 +-
get-started/architecture/index.html | 2 +-
get-started/demo/index.html | 2 +-
get-started/environment/index.html | 2 +-
get-started/index.html | 2 +-
get-started/supporting-apache/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
index.html | 2 +-
jupyter-notebooks-for-data-analysis/index.html | 2 +-
open-network-insight-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
project-components/ingestion/index.html | 2 +-
project-components/machine-learning/index.html | 2 +-
project-components/open-data-models/index.html | 2 +-
project-components/suspicious-connects-analysis/index.html | 2 +-
project-components/visualization/index.html | 2 +-
.../index.html | 2 +-
tag/github/index.html | 2 +-
tag/open-network-insight/index.html | 2 +-
tag/open-source/index.html | 2 +-
45 files changed, 45 insertions(+), 45 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 1120fd2..ccc35fd 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/2016/08/index.html b/2016/08/index.html
index 6e5288a..f946bd4 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -250,7 +250,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/2016/09/index.html b/2016/09/index.html
index 937f320..dbec30c 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -216,7 +216,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/2016/10/index.html b/2016/10/index.html
index 532c697..1fffe22 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/2017/03/index.html b/2017/03/index.html
index aee5f7e..3c2d5bd 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -217,7 +217,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/apache-spot-3-most-asked-questions/index.html b/apache-spot-3-most-asked-questions/index.html
index e804b82..c139044 100755
--- a/apache-spot-3-most-asked-questions/index.html
+++ b/apache-spot-3-most-asked-questions/index.html
@@ -294,7 +294,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index aaef9fa..98ddb1d 100755
--- a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -299,7 +299,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index 736f7fc..0ec20aa 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -253,7 +253,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 8b50dc9..a2e34e0 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -258,7 +258,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index 7d03752..1e074bb 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -247,7 +247,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 35dda0b..485a948 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -240,7 +240,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/index.html b/blog/index.html
index 9825ace..9a506df 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -338,7 +338,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index eceffec..19f1831 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -288,7 +288,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 64e75fe..b8c27d1 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -229,7 +229,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index c7585ae..0f06816 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 61725d9..cfd5d57 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 44a361d..d21d430 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index a15eade..dc8305c 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 05885c9..1ee8576 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 95308b2..1af11b7 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -271,7 +271,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/community/committers/index.html b/community/committers/index.html
index 023a4f2..c08a517 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -348,7 +348,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index 6199429..032bf21 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -275,7 +275,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/community/index.html b/community/index.html
index 81f8efd..930093a 100755
--- a/community/index.html
+++ b/community/index.html
@@ -230,7 +230,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/contribute/index.html b/contribute/index.html
index 537c8c9..a2191e3 100755
--- a/contribute/index.html
+++ b/contribute/index.html
@@ -206,7 +206,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/download/index.html b/download/index.html
index 710291b..0180dd0 100755
--- a/download/index.html
+++ b/download/index.html
@@ -215,7 +215,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index 758f599..6cc4bac 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -164,7 +164,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
index 8f56b58..b031252 100755
--- a/get-started/demo/index.html
+++ b/get-started/demo/index.html
@@ -167,7 +167,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
index 1789c4f..0e90f7b 100755
--- a/get-started/environment/index.html
+++ b/get-started/environment/index.html
@@ -172,7 +172,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/get-started/index.html b/get-started/index.html
index f554ac6..7650b94 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -210,7 +210,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
index dde5c6c..0951075 100755
--- a/get-started/supporting-apache/index.html
+++ b/get-started/supporting-apache/index.html
@@ -205,7 +205,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index dc3589f..0dac8ae 100644
--- a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -275,7 +275,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot (Incubating).
+ © 2019 Apache Spot (Incubating).
</p>
</div>
diff --git a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index f31bdd1..9bdd27c 100644
--- a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -287,7 +287,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot (Incubating).
+ © 2019 Apache Spot (Incubating).
</p>
</div>
diff --git a/index.html b/index.html
index be7aa7c..402168d 100755
--- a/index.html
+++ b/index.html
@@ -431,7 +431,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/jupyter-notebooks-for-data-analysis/index.html b/jupyter-notebooks-for-data-analysis/index.html
index 47afad9..f56bac1 100644
--- a/jupyter-notebooks-for-data-analysis/index.html
+++ b/jupyter-notebooks-for-data-analysis/index.html
@@ -314,7 +314,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot (Incubating).
+ © 2019 Apache Spot (Incubating).
</p>
</div>
diff --git a/open-network-insight-3-most-asked-questions/index.html b/open-network-insight-3-most-asked-questions/index.html
index 1bb6e49..440212e 100644
--- a/open-network-insight-3-most-asked-questions/index.html
+++ b/open-network-insight-3-most-asked-questions/index.html
@@ -300,7 +300,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index c6f1b7a..65cd1a4 100644
--- a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -305,7 +305,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index c00fcc3..9c57568 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -204,7 +204,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index e41e965..d6a5c43 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -180,7 +180,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 0840478..e6dd434 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -187,7 +187,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
index d9490bf..fddfff5 100755
--- a/project-components/suspicious-connects-analysis/index.html
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -447,7 +447,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index 251d178..b0b31fc 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -203,7 +203,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 272639a..befe9a2 100755
--- a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -259,7 +259,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/tag/github/index.html b/tag/github/index.html
index d6ae216..340674d 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 81fcaba..0e74028 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 062907e..04309c2 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2018 Apache Spot.
+ © 2019 Apache Spot.
</p>
</div>
[incubator-spot] 29/45: Per Incubator board request,
replacing the name of Dowload section until Apache Release process
for Spot is completed. Changing to GitHub on all other Index files
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 70608cc9fcbfd6e5350ad42734e4693e4b923fd7
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Thu Jul 27 20:51:04 2017 -0500
Per Incubator board request, replacing the name of Dowload section until Apache Release process for Spot is completed. Changing to GitHub on all other Index files
---
blog/index.html | 16 +-
community/index.html | 28 +-
contribute/index.html | 64 ++---
doc/index.html | 375 ++++++++++++-------------
jupyter-notebooks-for-data-analysis/index.html | 10 +-
5 files changed, 246 insertions(+), 247 deletions(-)
diff --git a/blog/index.html b/blog/index.html
index 64a218b..ff8887c 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -71,13 +71,13 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
@@ -119,7 +119,7 @@
<div id="inner-content" class="wrap cf">
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
+
<article class="cf post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
<header class="entry-header article-header">
@@ -144,7 +144,7 @@
</footer>
- </article>
+ </article>
<article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
@@ -274,7 +274,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -318,7 +318,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/community/index.html b/community/index.html
index 8625ee0..0ecb6e7 100755
--- a/community/index.html
+++ b/community/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -71,13 +71,13 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li class="active"><a href="../community" class="mail">Mailing Lists</a></li>
+ <li class="active"><a href="../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
@@ -114,36 +114,36 @@
</header>
<div id="mobile-nav"></div>
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1>Apache Spot Mailing Lists and Chat Rooms</h1>
<p>Get help using Spot or contribute to the project on our mailing lists or our chat room:</p>
-
+
<ul>
<li><a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Spot Slack channel</a> - where many Spot developers and users hang out to answer questions and chat.</li>
- </ul>
-
+ </ul>
+
<strong>Developer mailing lists</strong>
<ul>
<li><a href="mailto:dev@spot.incubator.apache.org">dev@spot.incubator.apache.org</a> (<a href="mailto:dev-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:dev-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-dev/" target="_blank">archives</a>) - for people who want to contribute code to Spot.</li>
<li><a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issue tracker.</li>
<li><a href="mailto:commits@spot.incubator.apache.org">commits@spot.incubator.apache.org</a> (<a href="mailto:commits-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:commits-subscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/incubator-spot-commits/" target="_blank">archives</a>) - receives an email notification of all code changes to the Spot Git repository.</li>
- </ul>
-
+ </ul>
+
<strong>Other developer resources</strong>
<ul>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
</ul>
-
+
</div>
</div>
-
+
</div>
@@ -185,4 +185,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/contribute/index.html b/contribute/index.html
index 325939b..81f26a2 100755
--- a/contribute/index.html
+++ b/contribute/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -60,7 +60,7 @@
<div class="social-sidebar">
<a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
<header class="header">
@@ -76,7 +76,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../contribute">Contribute</a>
@@ -104,25 +104,25 @@
</header>
<div id="mobile-nav"></div>
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Proposed Apache-Spot (incubating) Commit Workflow</h1>
-
+
<p><strong>NOTE: Most of this guide is based on ASF Documentation.</strong></p>
-
+
<p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.</p>
-
+
<p>Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
-
+
<h3 class="center" style="margin-top:35px;">Individual Push (most commonly used by the community):</h3>
-
+
<p><img src="../library/images/individual-push.png" alt="" /></p>
-
+
<p><strong>Steps:</strong></p>
-
+
<ol>
<li>For the Github repository at <a href="https://github.com/apache/incubator-spot" target="_blank">https://github.com/apache/incubator-spot</a> if you haven't already. For more information about Fork please go to: <a href="https://help.github.com/articles/fork-a-repo/" target="_blank">https://help.github.com/articles/fork-a-repo/</a></li>
<li>Clone your fork, create a new branch named after a Jira issue (i.e. <strong>spot-100</strong>).</li>
@@ -131,43 +131,43 @@
<li>Create a pull request (PR) against the upstream repo (master) of apache-spot. For more information about how to create a pull request please go to: <a href="https://help.github.com/articles/about-pull-requests/" target="_blank">https://help.github.com/articles/about-pull-requests/</a>.</li>
<li>Wait for the maintainers to review your PR.</li>
</ol>
-
+
<h3 class="center" style="margin-top:35px;">Topic Branching (upstream)</h3>
-
+
<p>What are a topic branches?</p>
-
+
<blockquote>According to the git definition: "<em>A topic branch is a short-lived branch that you create and use for a single particular feature or related work.</em>" (<a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches</a>)</blockquote>
-
+
<p>Sometimes a new major feature will have dependencies between modules or developers that can't be separated into individual pushes, when this happens, a topic branch will be created to deliver the complete functionality before the merge with the upstream (encapsulated dev enviroment).</p>
-
+
<p>In order to create a topic branch, three requirements are needed:</p>
-
+
<ol>
<li>A design document must be uploaded using Jira. This design must be approved by the maintainers.</li>
<li>A voting process will be required to approve the topic branch creation, at least 3 maintainers need to approve it.</li>
<li>A commitment to delete the branch after merging it into the upstream branch must be done. The topic branch should only exist while the work is still in progress.</li>
</ol>
-
+
<p>A meaningful name must be given to the branch. It is recommended to use JIRA issue created with the design document to link the branch.</p>
-
+
<p><img src="../library/images/topic-branching.png" alt="" /></p>
-
+
<p><strong>IMPORTANT: There shouldn't be a push without a Jira created previously</strong></p>
-
+
<h3>Approvals and Voting Process:</h3>
-
+
<blockquote>
- <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
-
+ <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
+
<p>Unless a vote has been declared as using <u>lazy consensus</u>, three +1 votes are required for a code-modification proposal to pass.</p>
-
+
<p>Whole numbers are recommended for this type of vote, as the opinion being expressed is Boolean: 'I approve/do not approve of this change.'</p>
-
+
<p><strong>Source: <a href="http://apache.org/foundation/voting.html" target="_blank">http://apache.org/foundation/voting.html</a></strong></p>
</blockquote>
-
+
<h3>Useful links:</h3>
-
+
<ul>
<li><a href="https://www.apache.org/foundation/glossary.html" target="_blank">https://www.apache.org/foundation/glossary.html</a></li>
<li><a href="http://www.apache.org/dev/committers" target="_blank">http://www.apache.org/dev/committers</a></li>
@@ -176,7 +176,7 @@
</ul>
</div>
</div>
-
+
</div>
@@ -221,4 +221,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/doc/index.html b/doc/index.html
index 39bf410..48a85c6 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -56,13 +56,13 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li class="menu-item">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
@@ -100,35 +100,35 @@
</header>
<div id="mobile-nav"></div>
-
+
<div id="masthead"></div>
-
+
<div id="mainwrap">
<nav class="cbp-spmenu cbp-spmenu-vertical cbp-spmenu-left" id="cbp-spmenu-s1">
<button id="showLeft"><span class="menuicon-menu"></span></button>
-
+
<h3>Documents</h3>
<a href="#introduction">Introduction <span class="icon-keyboard_arrow_right"></span></a>
- <a href="#environment">Environment <span class="icon-keyboard_arrow_right"></span></a>
- <a href="#installation" class="sub-menu">Installation <span class="icon-keyboard_arrow_right"></span></a>
+ <a href="#environment">Environment <span class="icon-keyboard_arrow_right"></span></a>
+ <a href="#installation" class="sub-menu">Installation <span class="icon-keyboard_arrow_right"></span></a>
<ul>
<li><a href="#requirements">Requirements</a></li>
- <li><a href="#deployment">Deployment</a> </li>
- <li><a href="#configuration">Configuration</a></li>
- <li><a href="#ingest">Ingest</a></li>
+ <li><a href="#deployment">Deployment</a> </li>
+ <li><a href="#configuration">Configuration</a></li>
+ <li><a href="#ingest">Ingest</a></li>
<li><a href="#ml">Machine Learning</a></li>
- <li><a href="#oa">OA</a></li>
- </ul>
+ <li><a href="#oa">OA</a></li>
+ </ul>
<a href="#userguide" class="sub-menu">User Guide <span class="icon-keyboard_arrow_right"></span></a>
<ul>
<li><a href="#uflow">Flow</a></li>
- <li><a href="#udns">DNS</a> </li>
- <li><a href="#uproxy">Proxy</a></li>
+ <li><a href="#udns">DNS</a> </li>
+ <li><a href="#uproxy">Proxy</a></li>
</ul>
</nav>
-
+
<div class="main">
<div id="introduction">
<h1>Introduction</h1>
@@ -136,7 +136,7 @@
Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.
<br>
</p>
- <img src="images/1.1_technical_overviewv02.jpg" style="margin:30px 0;" alt="" /><br><br>
+ <img src="images/1.1_technical_overviewv02.jpg" style="margin:30px 0;" alt="" /><br><br>
<h3>Parallel Ingest Framework.</h3>
<p>
The system uses decoders optimized from open source, that decodes binary flow and packet data, then loading the data in HDFS and data structures inside Hadoop. The decoded data is stored in multiple formats so it is available for searching, used by machine learning, transfer to law enforcement, or inputs to other systems.
@@ -147,7 +147,7 @@
</p>
<h3>Operational Analytics.</h3>
<p>
- In addition to machine learning, a proven process of context enrichment, noise filtering, whitelisting, and heuristics are applied to network data to produce a short list of the most likely patterns, which may be security threats.<br><br>
+ In addition to machine learning, a proven process of context enrichment, noise filtering, whitelisting, and heuristics are applied to network data to produce a short list of the most likely patterns, which may be security threats.<br><br>
</p>
</div>
</div>
@@ -157,51 +157,51 @@
<h3>Pure Hadoop</h3>
<p>
Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of CDH (see diagram below).<br><br>
-
+
This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.<br><br>
</p>
<img src="images/pure_hadoop.png" alt="" /><br><br>
-
+
<p>
In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource manage [...]
-
- Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly <br><br>
+
+ Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly <br><br>
</p>
<h3>Hybrid Hadoop</h3>
-
+
<p>
On existing Hadoop installations, a different approach involves using additional virtual machines and interacting with Hadoop components (Spark, HDFS) through a gateway node. This approach is recommended for customers with a Hadoop environment hosting heterogeneous use cases, where minimal deviation from node roles is desired. The disadvantage is that virtual machines must be sized properly according to workloads.<br><br>
</p>
<img src="images/hybrid_hadoop.png" alt="" /><br><br>
-
+
<p>
In addition to the services deployed on the existing cluster, additional Virtual Machines (VMs) are required to host the non-Hadoop functions of the solution. The gateway service is required for some of these VMs to allow for interaction with Spark, Hive, and HDFS.<br><br>
</p>
-
+
<strong>Note:</strong> While the above condition is a recommended layout for production, pilot deployments may be chosen to combine the above roles into fewer VMs. Each component of the Apache Spot (incubating) solution has integral interactions with Hadoop, but its non-Hadoop processing and memory requirements are separable with this approach.<br><br>
-
+
</div>
</div>
<div class="main">
<div id="installation">
<h1>Installation</h1>
<div id="requirements">
-
+
This version of the installation guide has been validated for clusters with HDFS running CDH.<br>
<h3>1. CDH (Cloudera Distribution of Hadoop) Requirements:</h3>
<p>
<strong>Minimum required version:</strong> 5.4<br>
<strong>NOTE:</strong> Spot requires spark 1.6, if you are using CDH < 5.7 please upgrade your spark version to 1.6.</p>
<p class="orange-bold" style="margin-bottom:0;">Required Hadoop Services before install apache spot (incubating):</p>
- <ul>
+ <ul>
<li>HDFS.</li>
<li>HIVE.</li>
<li>IMPALA.</li>
<li>KAFKA.</li>
<li>SPARK (YARN).</li>
<li>YARN.</li>
- <li>Zookeeper.</li>
- </ul>
+ <li>Zookeeper.</li>
+ </ul>
</div>
<div id="deployment">
<h3>2. Deployment Recommendations</h3>
@@ -211,7 +211,7 @@
<li><strong>spot-ingest</strong> — binary and log files are captured or transferred into the Hadoop cluster, where they are transformed and loaded into solution data stores.</li>
<li><strong>spot-ml</strong> — machine learning algorithms are used to add additional learning information to the ingest data, which is used to filter and sort raw data.</li>
<li><strong>spot-oa</strong>— data output from the machine learning component is augmented with context and heuristics, then is available to the user for interacting with it.</li>
- </ul>
+ </ul>
While all of the components can be installed on the same server in a development or test scenario, the recommended configuration for production is to map the components to specific server roles in a Hadoop cluster.<br><br>
<table class="configuration">
<tr>
@@ -240,41 +240,41 @@
<h3>3. Configuring the cluster.</h3>
<h4 class="gray">3.1 Create a user account for apache spot (incubating).</h4>
<p>
- Before starting the installation,
- the recommended approach is to create a user account with super user privileges (sudo)
+ Before starting the installation,
+ the recommended approach is to create a user account with super user privileges (sudo)
and with access to HDFS in each one of the nodes where apache spot (incubating) is going to be installed ( i.e. edge server, yarn node).<br>
</p>
-
+
<p class="orange-bold">Add user to all apache spot (incubating) nodes:</p>
- <p class="terminal">
+ <p class="terminal">
sudo adduser <solution-user><br>
passwd <solution-user>
</p><br>
-
+
<p class="orange-bold">Add user to HDFS supergroup (IMPORTANT: this should be done in the Name Node) :</p>
<p class="terminal">
sudo usermod -G supergroup $username
</p><br>
-
+
<h4 class="gray">3.2 Get the code.</h4>
Go to the home directory of the solution user in the node assigned for spot-setup and spot-ingest and clone the code:<br><br>
<p class="terminal">
git clone https://github.com/apache/incubator-spot.git
</p><br>
-
+
<h4 class="gray">3.3 Edit apache spot (incubating) configuration.</h4>
Go to apache spot (incubating) configuration module to edit the solution configuration:<br><br>
<p class="terminal">
cd /home/solution_user/incubator-spot/spot-setup<br>
vi spot.conf
</p><br>
-
+
Configuration variables of apache spot (incubating):<br><br>
<table class="configuration config2">
<tr>
<th>Key</th>
<th>Value</th>
- <th>Need to be edited</th>
+ <th>Need to be edited</th>
<tr>
<td>NODES</td>
<td style="text-align:left">A space delimited list of the Data Nodes that will run the C/MPI part of the pipeline. Be very careful to keep * the variable in the format ('host1' 'host2' 'host3' ...). The first node is the same node as the MLNODE.</td>
@@ -419,38 +419,38 @@
<td>SPK_DRIVER_MEM_OVERHEAD</td>
<td style="text-align:left">Driver memory overhead</td>
<td>Yes</td>
- </tr>
+ </tr>
<tr>
<td>SPRK_EXEC_MEM_OVERHEAD</td>
<td style="text-align:left">Executor memory overhead</td>
<td>Yes</td>
- </tr>
+ </tr>
<tr>
<td>TOL</td>
<td style="text-align:left">Results threshold</td>
<td>No</td>
- </tr>
+ </tr>
</table>
<br><br>
<p><strong>NOTE:</strong> deprecated keys will be removed in the next releases.<br>
More details about how to set up Spark properties please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/SPARKCONF.md">Spark Configuration</a></p>
-
+
<h4 class="gray">3.4 Run spot-setup.</h4>
<p class="short-mrg">Copy the configuration file edited in the previous step to "/etc/" folder.</p>
<p class="terminal">
- sudo cp spot.conf /etc/.
+ sudo cp spot.conf /etc/.
</p>
-
+
<p class="short-mrg">Copy the configuration to the two nodes named as UINODE and MLNODE.</p>
<p class="terminal">
sudo scp spot.conf solution_user@node:/etc/.
</p>
-
+
<p class="short-mrg">Run the hdfs_setup.sh script to create folders in Hadoop for the different use cases (flow, DNS or Proxy), create the Hive database, and finally execute hive query scripts that creates Hive tables needed to access netflow, DNS and proxy data.</p>
<p class="terminal">
./hdfs_setup.sh
</p>
-
+
</div>
<div id="ingest">
<h3>4 Ingest.</h3>
@@ -458,7 +458,7 @@
<p>
Copy the ingest folder (spot-ingest) to the selected node for ingest process (i.e. edge server). If you cloned the code in the edge server and you are planning to use the same server for ingest you dont need to copy the folder.
</p>
-
+
<h4 class="gray">4.2 Ingest dependencies.</h4>
<ul>
<li>
@@ -532,7 +532,7 @@
</p><br>
</li>
</ul>
-
+
<h4 class="gray">4.3 Ingest configuration.</h4>
<p class="short-mrg">Ingest Configuration:</p>
<p class="short-mrg">The file ingest_conf.json contains all the required configuration to start the ingest module</p>
@@ -548,7 +548,7 @@
<p class="short-mrg">For more information about spot ingest please go to <a href="https://github.com/apache/incubator-spot/tree/master/spot-ingest"> spot-ingest</a></p>
</div>
<div id="ml">
-
+
<h3>5. Machine Learning.</h3>
<h4 class="gray">5.1 ML code.</h4>
<p class="short-mrg">Copy ML code to the primary ML node, the node will launch Spark application.</p>
@@ -558,7 +558,7 @@
cd /home/"solution-user"/ml
</p>
-
+
<h4 class="gray">5.1 ML dependencies</h4>
<ul>
<li>
@@ -570,27 +570,27 @@
</li>
<li><p class="short-mrg">Install sbt -- In order to build Scala code, a SBT installation is required. Please download and install <a href="http://www.scala-sbt.org/download.html">download.</a></p></li>
<li>
- <p class="short-mrg">Build Spark application.</p>
+ <p class="short-mrg">Build Spark application.</p>
<p class="terminal">
cd ml<br>
sbt assembly
</p>
</li>
</ul>
-
+
<p class="short-mrg"><strong>NOTE:</strong> validate spot.conf is already copied to this node in the following path: /etc/spot.conf</p>
</div>
<div id="oa">
<h3>6. Operational Analytics.</h3>
<h4 class="gray">6.1 OA code.</h4>
-
+
<p class="short-mrg">Copy spot-oa code to the OA node designed in the configuration file (UINODE).</p>
<p class="terminal">
scp -r spot-oa "ml-node":/home/"solution-user"/. <br>
ssh "oa-node"<br>
- cd /home/"solution-user"/spot-oa
+ cd /home/"solution-user"/spot-oa
</p><br>
-
+
<h4 class="gray">6.2 OA prerequisites.</h4>
<p class="short-mrg">In order to execute this process there are a few prerequisites:</p>
<ul>
@@ -599,7 +599,7 @@
implementation of Machine Learning in this project is through spot-ml. Although the Operational Analytics is prepared to read csv files and there is not a direct dependency between spot-oa and spot-ml, it's highly recommended to have these two pieces set up together. If users want to implement their own machine learning piece to detect suspicious connections they need to refer to each data type module to know more about input format and schema.</li>
<li><a href="https://pypi.python.org/pypi/tld/0.7.6"> TLD 0.7.6</a></li>
</ul>
-
+
<h4 class="gray">6.3 OA (backend) installation.</h4>
<p class="short-mrg">OA installation consists of the configuration of extra modules or components and creation of a set of files. Depending on the data type that is going to be processed some components are required and other components are not. If users are planning to analyze the three data types supported (Flow, DNS and Proxy) then all components should be configured.</p>
<ol>
@@ -608,7 +608,7 @@
<p class="short-mrg">Add a file ipranges.csv: Ip ranges file is used by OA when running data type Flow. It should contain a list of ip ranges and the label for the given range, example:</p>
<p class="terminal">
10.0.0.1,10.255.255.255,Internal
- </p>
+ </p>
</li>
<li>
<p class="short-mrg">Add a file iploc.csv: Ip localization file used by OA when running data type Flow. Create a csv file with ip ranges in integer format and give the coordinates for each range.</p>
@@ -643,28 +643,28 @@
},
"hive":{}
}
-
+
</p>
<p class="short-mrg">Where:</p>
<ul>
<li>"oa_data_engine": Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the following keys, where you'll need to add the corresponding node name.<br></li>
<li>"impala_daemon": The node name in your cluster where you have the database service running.</li>
</ul>
- </li>
+ </li>
</ol>
<p class="short-mrg">For more information please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md"> https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md</a></p>
-
+
<h3>6.4 Visualization.</h3>
<p>Apache Spot (incubating) - User Interface (aka Spot UI or UI) Provides tools for interactive visualization, noise filters, white listing, and attack heuristics.</p>
<p>Here you will find instructions to get Spot UI up and running. For more information about Spot look here.</p>
-
+
<h3>6.5 Visualization requirements.</h3>
<ul>
<li>IPython with notebook module enabled (== 3.2.0) <a href="https://ipython.org/ipython-doc/3/index.html"> link</a></li>
<li>NPM - Node Package Manager <a href="https://www.npmjs.com"> link</a></li>
<li>spot-oa output > Spot UI takes any output from spot-oa backend, as input for the visualization tools provided. Please make sure there are files available under PATH_TO_SPOT/ui/data/${PIPELINE}/${DATE}/</li>
</ul>
-
+
<h3>6.6 Install visualization.</h3>
<ol>
<li>
@@ -696,15 +696,15 @@
<img src="images/1.1sc1.jpg" class="box-shadow" alt="" />
<p class="short-mrg">
Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
-
+
<ul>
<li>Suspicious</li>
<li>Network View</li>
<li>Notebook</li>
- <li>Details</li>
+ <li>Details</li>
</ul>
</p>
-
+
<h4 class="gray">The Suspicious frame</h4>
<p class="short-mrg">
Located in the top left corner of the Suspicious Connects Web Page, this frame presents the Top 250 Suspicious Connections in a table format based on Machine Learning (ML) output. These are the columns depicted in this table:</p>
@@ -717,12 +717,12 @@
<li>Destination Port - Netflow Record TCP/UDP Destination Port Number</li>
<li>Protocol - Text format for Protocol contained within Netflow Record (Ex. TCP/UDP)</li>
<li>Input Packets - Reported Input Packets for the Netflow Record</li>
- <li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
+ <li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
</ul>
</p>
<p class="orange-bold" style="margin-bottom:0;">Additional functionality in Suspicious frame</strong>
- <ol>
+ <ol>
<li>
By selecting a specific row within the Suspicious frame, the connection in the Network View will be highlighted.<br><br>
<img src="images/1.1_sc2.jpg" class="box-shadow" alt="" />
@@ -742,13 +742,13 @@
</li>
</ol>
</p>
-
+
<h4 class="gray">The Network View frame</h4>
<p class="short-mrg">Located at the top right corner of the Suspicious Connects Web Page. It is a graphical representation of the Suspicious records relationships.</p>
<p class="short-mrg">If context has been added, Internal IP Addresses will be presented as diamonds and External IP Addresses as circles.</p>
<img src="images/1.1_sc6.jpg" class="box-shadow" alt="" /><br><br>
<p class="orange-bold" style="margin-bottom:0;">Additional functionality in Network View frame</p>
- <ol>
+ <ol>
<li>
<p class="short-mrg">As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.</p>
<img src="images/1.1_sc7.jpg" class="box-shadow" alt="" />
@@ -762,34 +762,34 @@
<li>
<p class="short-mrg">A secondary mouse click uses the node information in order to apply an IP filter to the Suspicious Web Page.</p>
<img src="images/1.1_sc9.jpg" class="box-shadow" alt="" />
- </li>
+ </li>
</ol>
-
+
<h4 class="gray">The Notebook frame</h4>
<p class="short-mrg">This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score IP Addresses and Ports with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, there [...]
<img src="images/1.1_sc10.jpg" class="box-shadow" alt="" />
-
+
<h4 class="gray">The Score button</h4>
<p class="short-mrg">When the Analyst clicks on the Score button, the action will find all coincidences exactly matching the selected values and update their score to the rating selected in the radio button list.</p>
-
+
<h4 class="gray">The Save button</h4>
<p class="short-mrg">Analysts must use Save button in order to store the scored connections. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page, including from the lists in the notebook. This will also reorder the flow_scores.csv file to move all scored connections to the end of the file and sort the rest by severity value. A shell script will be execute [...]
-
+
<ul>
<li>LPATH</li>
<li>MLNODE</li>
<li>LUSER</li>
</ul>
-
+
<p class="short-mrg">For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
-
+
<h4 class="gray">The Quick IP Scoring box</h4>
<p class="short-mrg">This box allows the Analyst to enter an IP Address and scored using the "Score" and "Save" buttons using the same process depicted above.</p>
-
+
<h4 class="gray">Suspicious Connects Web Page Input files</h4>
<ul>
<li>flow_scores.csv</li>
- <li>flow_scores_bu.csv</li>
+ <li>flow_scores_bu.csv</li>
</ul>
</div>
<div id="fti">
@@ -798,19 +798,19 @@
<p class="short-mrg">Select the date that you want to review.</p>
<p class="short-mrg">Your screen should now look like this:</p>
<img src="images/1.1sc1.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">The analyst must score the suspicious connections before moving into Threat Investigation View, please refer to <a href="#fsc">Suspicious Connects Analyst View</a> walk-through.</p>
-
+
<p class="short-mrg">Select <strong>Flows > Threat Investigation </strong> from apache spot (incubating) Menu.</p>
-
+
<img src="images/1.1_ti01.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg"><strong>Threat Investigation</strong> Web Page will be opened, loading the embedded IPython notebook.</p>
<img src="images/1.1_ti02.jpg" class="box-shadow" alt="" />
-
+
<h4 class="gray">Expanded search</h4>
<p class="short-mrg">You can select any IP from the list and click <strong>Search</strong> to view specific details about it. A query to the flow table will be executed looking into the raw data initially collected to find all communication between this and any other IP Addresses during the day, collecting additional information, such as:</p>
-
+
<ul>
<li>max & avg number of bytes sent/received</li>
<li>max & avg number of packets sent/received</li>
@@ -819,69 +819,69 @@
<li>first & last connection time</li>
<li>count of connections</li>
</ul>
-
+
<p class="short-mrg">The full output of this query is stored into the ir-<ip>.csv file. If an expanded search was previously executed on this IP, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used.</p>
-
+
<p class="short-mrg">Based on the results in this file, the following functions will be executed:</p>
-
+
<ul>
<li>get_in_out_and_twoway_conns</li>
<li>add_geospatial_info()</li>
<li>add_network_context()</li>
</ul>
-
+
<p class="short-mrg">The system will create three dictionaries, each containing:</p>
<ul>
<li>Inbound connections (when the suspicious IP acts only as destination)</li>
<li>Outbound connections (when the suspicious IP acts only as source)</li>
<li>2Way Connections (when the suspicious IP acts as both source and destination)</li>
-
+
</ul>
-
+
<p class="short-mrg">If an iploc.csv file is available, each dictionary will be updated with the geolocation data for each IP.</p>
-
+
<p class="short-mrg">If a network_context_1.txt file is available, a description for each identified node will also be added to each dictionary.</p>
-
+
<p class="short-mrg">The connections dictionary will be separated into two smaller dictionaries, each containing</p>
<ul>
<li>Top 'n' IP's per number of connections.</li>
<li>Top 'n' IP's per bytes transferred.</li>
<li>The number of results stored in the dictionaries (n) can be set by updating the value of the top_results variable.</li>
</ul>
-
+
<h4 class="gray">Save Comments</h4>
<p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
<p class="short-mrg">Click on the Save button after entering the data to write it into a CSV file, which eventually will be used in the Storyboard Analyst View.</p>
<img src="images/1.1_ti03.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">After creating the csv file with the analysis description, the following functions will generate all graphs and diagrams related to the IP under investigation, to populate the Storyboard Analyst view.</p>
-
+
<ul>
<li>generate_attack_map_file(anchor_ip, top_inbound_b, outbound, twoway)</li>
<li>generate_stats(anchor_ip, top_inbound_b, outbound, twoway, threat_name)</li>
<li>generate_dendro(anchor_ip, top_inbound_b, outbound, twoway, date)</li>
<li>details_inbound(anchor_ip,top_inbound_b)</li>
</ul>
-
+
<p><strong>generate_attack_map_file()</strong> - create a globe map indicating the trajectory of the connections based on their geolocation. This function depends on having geolocation data for each IP. If you haven't set up a geolocation database file, the map file won't be generated.<br><strong>Output:</strong> globe_<ip>.json</p>
-
+
<p><strong>generate_stats()</strong> - This will create the horizontal bar graph for the Impact Analysis.This will represent the number of inbound, outbound and twoway connections found.<br>
<strong>Output:</strong> stats-<ip>.json</p>
-
+
<p><strong>generate_dendro()</strong> - This function creates a file linking all different IP's that have connected to the IP under investigation, this will be displayed in the Storyboard under the Incident Progression panel as a dendrogram. If no network context file is included, the dendrogram will only be 1 level deep, but if a network context file is included, additional levels will be added to the dendrogram to break down the threat activity.<br>
<strong>Output:</strong> dendro-<ip>.json</p>
-
+
<p><strong>details_inbound()</strong> - This function executes a query to the flow table, to find additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br>
<strong>Output:</strong> sbdet-<ip>.tsv</p>
-
+
<p><strong>add_threat()</strong> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed. This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br><strong>Output:</strong> threats.csv</p>
-
+
<p>Each function will print a message to let you know if its output file was successfully updated.</p>
-
+
<h4 class="gray">Continue to the Storyboard</h4>
<p>Once you have saved comments on any suspicious IP, you can continue to the Storyboard to check the results.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>flow_scores.csv</li>
@@ -894,13 +894,13 @@
<li>/oni-oa/data/flow/<date>/threats.csv</li>
<li>/oni-oa/data/flow/<date>/threat_<ip>.csv</li>
- <li>/oni-oa/data/flow/<date>/sbdet-<ip>.tsv</li>
- <li>/oni-oa/data/flow/<date>/globe_<ip>.json</li>
- <li>/oni-oa/data/flow/<date>/stats-<ip>.json</li>
+ <li>/oni-oa/data/flow/<date>/sbdet-<ip>.tsv</li>
+ <li>/oni-oa/data/flow/<date>/globe_<ip>.json</li>
+ <li>/oni-oa/data/flow/<date>/stats-<ip>.json</li>
<li>/oni-oa/data/flow/<date>/dendro-<ip>.json</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
+ </ul>
+
+ <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
<ul>
<li>flow</li>
</ul>
@@ -919,41 +919,41 @@
</li>
<li>
<p class="short-mrg">Review the results:</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
<p class="short-mrg"><strong>Data source file:</strong> threats.csv Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and the additional information will be displayed.</p>
<p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.JPG" class="box-shadow" alt="" /></p>
-
+
<p class="short-mrg">Clicking on a threat from the list will also update the additional frames.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Incident Progression</p>
<p class="short-mrg"><strong>Data source file:</strong> dendro-<ip>.json<br>Frame located in the top right of the Storyboard Web page</p>
<img src="images/flow_sb_3.JPG" class="box-shadow" alt="" />
-
+
<p class="short-mrg">Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
<p class="short-mrg">When network context is available, this graph will present an extra level to break down each type of connection into detailed context.</p>
-
+
<p class="short-mrg"><strong>Impact Analysis Data source file:</strong> stats-<ip>.json</p>
<p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_4.JPG" class="box-shadow" alt="" /></p>
-
-
+
+
<p class="short-mrg">Impact Analysis displays a horizontal bar graph representing the number of inbound, outbound and two-way connections found related to the threat. Clicking any bar in the graph, will break down that information into its context.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Map View | Globe</p>
<p class="short-mrg"><strong>Data source file:</strong> globe_<ip>.json</p>
<p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_5.JPG" class="box-shadow" alt="" /></p>
-
+
<p class="short-mrg">Map View Globe will only be created if you have a geolocation database. This is intended to represent on a global scale the communication detected, using the geolocation data of each IP to print lines on the map showing the flow of the data.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Timeline</p>
<p class="short-mrg"><strong>Data source file:</strong> sbdet-<ip>.json</p>
<p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_6.JPG" class="box-shadow" alt="" /></p>
-
+
<p class="short-mrg">Timeline is created using the resulting connections found during the Threat Investigation process. It will display 'clusters' of inbound connections to the IP, grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll.</p>
-
+
<p class="short-mrg"><strong>Input files</strong></p>
- <ul>
+ <ul>
<li>threats.csv</li>
<li>threat-dendro-${id}.json</li>
<li>stats-${id}.json</li>
@@ -971,7 +971,7 @@
<img src="images/is1.png" class="box-shadow" alt="" />
</li>
<li>
- <p class="short-mrg">Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days.
+ <p class="short-mrg">Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days.
Your view should now look like this:</p>
<img src="images/is2.png" class="box-shadow" alt="" />
</li>
@@ -991,25 +991,25 @@
<h4 class="gray" style="margin-top:0;">Suspicious DNS</h4>
<ol>
<li>
- <p><strong>Open the analyst view for Suspicious DNS:</strong> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).</p>
+ <p><strong>Open the analyst view for Suspicious DNS:</strong> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).</p>
<p class="short-mrg">Your screen should now look like this:</p>
<img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg"><strong>The Suspicious</strong><br>Located at the top left of the Web page, this frame shows the top 250 suspicious DNS from the Machine Learning (ML) output.</p>
<ol>
- <li>By moving the mouse over a suspicious DNS,
+ <li>By moving the mouse over a suspicious DNS,
you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
</li>
<li>
- Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
+ Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
The icon will change its color depending upon the results from specific reputation services.<br><br>
</li>
<li>
- By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame.
+ By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame.
In addition Details frame will be populated with additional communications directed to the same DNS record.<br><br>
</li>
- </ol>
+ </ol>
</li>
<li>
<p class="short-mrg"><strong>The Network View frame</strong><br>Located at the top right corner, Network View is a graphic representation of the "Suspicious DNS".</p>
@@ -1050,58 +1050,58 @@
<ul>
<li>dns_scores.csv</li>
<li>dns_scores_bu.csv </li>
- </ul>
+ </ul>
</div>
<div id="dti">
<h4 class="gray">DNS Threat Investigation</h4>
<p>Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.</p>
<p class="short-mrg">Your view should now look like this:</p>
<img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.</p>
<p class="short-mrg">Select <strong>DNS > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
<img src="images/1.1_dns_ti01.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all IPs and DNS Names scored as High risk will be presented</p>
<img src="images/1.1_dns_ti02.png" class="box-shadow" alt="" />
-
+
<p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
<p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the dns table, looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following criteria:</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular Domain Name</p>
<p class="short-mrg">The query results will provide the different unique IP Addresses list that have queried this particular Domain, the list will be sorted by the quantity of connections.</p>
<p style="text-align:center;"><img src="images/1.1_dns_ti03.jpg" class="box-shadow" alt="" /></p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular IP</p>
<p class="short-mrg">The expanded search will provide the different unique Domains list that this particular IP queried in one day, they will be sorted by the quantity of connections made to each specific Domain Name.</p>
<p style="text-align: center;"><img src="images/1.1_dns_ti04.jpg" class="box-shadow" alt="" /></p>
-
+
<p class="short-mrg">The full output of this query is stored into the threat-dendro-<threat>.csv file, from which the top 'n' results will be extracted and displayed in a table. If an expanded search was previously executed on this IP or Domain, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used [...]
-
+
<p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
<p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
<img src="images/1.1_dns_ti05.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form. This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as a index of the threats analyzed.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Continue to the Storyboard.</p>
<p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>ipython/dns/user/<date>/dns_scores.css</li>
</ul>
-
+
<p class="orange-bold" style="margin-bottom:0;">Output files</p>
<ul>
<li>ipython/dns/user/<date>/threats.csv</li>
<li>ipython/dns/user/<date>/threat-dendro-<threat>.csv</li>
- </ul>
-
+ </ul>
+
<p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed: </p>
<p>dns</p>
-
+
</div>
<div id="dsb">
<h4 class="gray">DNS Storyboard</h4>
@@ -1119,18 +1119,18 @@
<p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
<p class="short-mrg"><strong>Data source file:</strong> threats.csv<br>
Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom area of the panel.</p>
-
+
<p class="short-mrg"><strong>Incident progression Data source file:</strong> threat-dendro-<threat>.csv<br>Incident progression frame is located on the right side of the Web page.</p>
-
+
<img src="images/1.1_dns_sb02.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
-
+
<p class="orange-bold" style="margin-bottom: 0;">Input files</p>
<ul>
<li>threats.csv</li>
<li>threat-dendro-<threat>.csv</li>
- </ul>
+ </ul>
</p>
</div>
</div>
@@ -1145,33 +1145,33 @@
<p class="short-mrg"><strong>Open the analyst view for Suspicious Proxy:</strong> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>. Select the date that you want to review (defaults to current date).</p>
<p class="short-mrg">Your screen should now look like this:</p>
<img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" /><br><br>
-
+
</li>
<li>
<p class="short-mrg"><strong>The Suspicious frame</strong><br>Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.</p>
-
+
<ol>
<li>
- By moving the mouse over a suspicious Proxy record,
+ By moving the mouse over a suspicious Proxy record,
you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
</li>
<li>
- The Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
+ The Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
The icon will change its color depending upon the results from the Reputation Service.<br><br>
</li>
<li>
The List icon. When the user mouse over this icon, it presents the Web Categories provided by the Reputation Service<br><br>
</li>
<li>
- By selecting on a Suspicious Proxy record, you will highlight current row as well as the node from Network View frame. In addition,
+ By selecting on a Suspicious Proxy record, you will highlight current row as well as the node from Network View frame. In addition,
Details frame will be populated with additional communications directed to the same Proxy record.<br><br>
</li>
- </ol>
+ </ol>
</li>
<li>
<p class="short-mrg"><strong>The Network View frame</strong><br>
Located at the top right corner, Network View is a hierarchical force graph used to represent the "Suspicious Proxy" connections.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Network View Force Graph Order Hierarchy</strong></p>
<ul>
<li>Root Proxy Node</li>
@@ -1210,11 +1210,11 @@
<p class="short-mrg">A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames </p>
<img src="images/1.1_proxy_sc08.jpg" class="box-shadow" alt="" />
</li>
- </ol>
+ </ol>
</li>
<li>
<p class="short-mrg" style="margin-bottom:0;"><strong>The Details frame</strong></p>
- <p class="short-mrg">Located at the bottom right corner of the Web page. It provides additional information for the selected connection in the Suspicious frame.
+ <p class="short-mrg">Located at the bottom right corner of the Web page. It provides additional information for the selected connection in the Suspicious frame.
It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type, Proxy Server IP, Bytes.</p>
<img src="images/1.1_proxy_sc09.jpg" class="box-shadow" alt="" />
</li>
@@ -1222,29 +1222,29 @@
<p class="short-mrg"><strong>The Notebook frame</strong><br>
This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score Proxy records with different values. In order to assign a risk to a specific connection, select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.</p>
<img src="images/1.1_proxy_sc10.jpg" class="box-shadow" alt="" />
-
+
</li>
</ol>
-
+
<p class="orange-bold" style="margin-bottom: 0;">The Score button</p>
<p>Pressing the 'Score' button will find all exact matches of the selected threat (Proxy Record) in the proxy_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the proxy_scores.csv file at the end of the process.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">The Save button</p>
<p class="short-mrg">Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:</p>
<ul>
<li>LPATH</li>
<li>MLNODE</li>
<li>LUSER</li>
- </ul>
-
+ </ul>
+
<p>For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>proxy_scores.csv </li>
<li>proxy_scores_bu.csv</li>
- </ul>
+ </ul>
</div>
<div id="pti">
<h4 class="gray">Proxy Threat Investigation</h4>
@@ -1252,40 +1252,40 @@
<p class="short-mrg">Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review.</p>
<p class="short-mrg">Your view should now look like this:</p>
<img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.</p>
<p class="short-mrg">Select <strong>Proxy > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
<img src="images/1.1_proxy_ti01.jpg" class="box-shadow" alt="" /><br><br>
-
+
<p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all Proxy Records scored as High risk will be presented</p>
<img src="images/1.1_proxy_ti02.jpg" class="box-shadow" alt="" /><br><br>
-
+
<p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
-
+
<p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the proxy table, looking into the raw data initially collected to find additional activity for the selected Proxy Record. Results will be extracted and displayed in a table. If an expanded search was previously executed on this Proxy Record, the system will extract the results from the preexisting file to reduce the execution time by avoiding anothe [...]
- <img src="images/1.1_proxy_ti03.jpg" class="box-shadow" alt="" />
+ <img src="images/1.1_proxy_ti03.jpg" class="box-shadow" alt="" />
<p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
<p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.</p>
- <img src="images/1.1_proxy_ti04.jpg" class="box-shadow" alt="" />
-
+ <img src="images/1.1_proxy_ti04.jpg" class="box-shadow" alt="" />
+
<p class="short-mrg">Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form. This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as an index of the threats analyzed.</p>
-
+
<p class="orange-bold" style="margin-bottom: 0;">Continue to the Storyboard.</p>
<p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>proxy_scores.tsv</li>
</ul>
-
+
<p class="orange-bold" style="margin-bottom:0;">Output files</p>
<ul>
<li>threats.csv</li>
<li>es-{id}.csv</li>
<li>incident-progression-{id}.json</li>
<li>timeline-{id}.tsv</li>
- </ul>
-
+ </ul>
+
<p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
<p>proxy</p>
</div>
@@ -1297,17 +1297,17 @@
<img src="images/1.1_proxy_sb01.jpg" class="box-shadow" alt="" />
</li>
<li>
- <p class="short-mrg">Your view should look something like this,
+ <p class="short-mrg">Your view should look something like this,
depending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
<img src="images/1.1_proxy_sb02.jpg" class="box-shadow" alt="" />
</li>
</ol>
-
+
<p class="orange-bold">Executive Threat Briefing</p>
<p class="short-mrg"><strong>Data source file:</strong> threats.csv<br>
Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom area of the panel.</p>
<p style="text-align: center;"><img src="images/1.1_proxy_sb03.jpg" class="box-shadow" alt="" /></p>
-
+
<p class="orange-bold" style="margin-bottom:0;">Incident progression</p>
<p class="short-mrg"><strong>Data source file:</strong> incident-progression-{id}.json<br>Incident progression frame is located on the right side of the Web page. Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat. It presents the following fields:</p>
<ul>
@@ -1318,14 +1318,14 @@
<li><strong>Threat</strong> - Represents the Suspicious Proxy Record</li>
<li><strong>Referred</strong> - URLs that the Suspicious Proxy Record referred to</li>
<img src="images/1.1_proxy_sb04.jpg" class="box-shadow" alt="" />
-
+
<p class="short-mrg">If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.</p>
<img src="images/1.1_proxy_sb06.jpg" class="box-shadow" alt="" /><br><br>
-
+
<p class="orange-bold" style="margin-bottom:0;">Timeline</p>
<p class="short-mrg"><strong>Data source file:</strong> timeline-{id}.tsv<br>Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll. The number next to the IP Address represents the quantity of [...]
<img src="images/1.1_proxy_sb05.jpg" class="box-shadow" alt="" /><br><br>
-
+
<p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
@@ -1337,9 +1337,9 @@
</div>
</div>
</div>
- </div>
+ </div>
</div><!--end main-wrap-->
-
+
<div id="more-info">
<div class="wrap cf">
@@ -1359,7 +1359,7 @@
</p>
</div>
</div>
-
+
<footer class="footer">
<div id="inner-footer" class="wrap cf">
@@ -1373,7 +1373,7 @@
</footer>
</div>
-
+
<a href="#0" class="cd-top">Top</a>
<script type='text/javascript' src='js/classie.js'></script>
<script type='text/javascript' src='js/scripts.js'></script>
@@ -1382,4 +1382,3 @@
</html>
<!-- end of site. what a ride! -->
-
diff --git a/jupyter-notebooks-for-data-analysis/index.html b/jupyter-notebooks-for-data-analysis/index.html
index 3d29fa1..a3dbec6 100644
--- a/jupyter-notebooks-for-data-analysis/index.html
+++ b/jupyter-notebooks-for-data-analysis/index.html
@@ -141,7 +141,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
@@ -257,12 +257,12 @@
We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot (Incubating)? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.
</p>
</section>
-
+
<footer class="article-footer">
-
+
filed under: <a href="../category/data-science/" rel="category tag">Data Science</a>, <a href="../category/ipython-notebooks/" rel="category tag">Ipython Notebooks</a>, <a href="../category/threat-analysis-tools/" rel="category tag">Threat Analysis Tools</a>
-
- </footer>
+
+ </footer>
</article>
[incubator-spot] 20/45: Correcting contact email address,
and naming on one of the architecture diagrams
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 7ee55f0455e244aa84488f69c267fd6f9f426d88
Author: Cesar <ce...@apache.org>
AuthorDate: Thu Jan 19 15:41:08 2017 -0600
Correcting contact email address, and naming on one of the architecture diagrams
---
doc/images/pure_hadoop.bmp | Bin 4963738 -> 4963738 bytes
index.html | 24 ++++++++++++------------
2 files changed, 12 insertions(+), 12 deletions(-)
diff --git a/doc/images/pure_hadoop.bmp b/doc/images/pure_hadoop.bmp
old mode 100755
new mode 100644
index 311d0b5..b266472
Binary files a/doc/images/pure_hadoop.bmp and b/doc/images/pure_hadoop.bmp differ
diff --git a/index.html b/index.html
index cc9d552..8cb0674 100755
--- a/index.html
+++ b/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -58,9 +58,9 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -116,7 +116,7 @@
</div>
</div>
</div>
-
+
<div id="at-a-glance">
<div class="wrap cf">
<h1>Apache Spot at a Glance</h1>
@@ -266,7 +266,7 @@
</p>
</div>
</div>
-
+
<div id="open-data-models">
<div class="wrap cf">
<h1 class="center">Apache Spot Open Data Models (ODM)</h1>
@@ -292,9 +292,9 @@
<p class="btn-margin center">
Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
</p>
-
+
<p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
-
+
<div class="community">
<img src="library/images/community/endgame.png" alt="Endgame" />
<img src="library/images/community/intel.png" alt="Intel" />
@@ -307,7 +307,7 @@
<img src="library/images/community/ebay.png" alt="Ebay" />
<img src="library/images/community/semantix.png" alt="Ebay" />
<img src="library/images/community/rich-it.png" alt="Ebay" />
-
+
</div>
</div>
@@ -373,11 +373,11 @@
</div>
</div>
</div>
-
+
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
@@ -415,4 +415,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
[incubator-spot] 25/45: Committer list updated
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 55d3e94f57a3af08bb6daf152be4034aae5de3c2
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Wed Mar 29 12:15:51 2017 -0600
Committer list updated
---
community/committers/index.html | 15 ++++++++++-----
1 file changed, 10 insertions(+), 5 deletions(-)
diff --git a/community/committers/index.html b/community/committers/index.html
index 75f46c5..cf1d062 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -161,11 +161,6 @@
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
- <div class="divTableCell">jarcec</div>
- <div class="divTableCell">Jarek Jarcec Cecho</div>
- <div class="divTableCell">PPMC</div>
- </div>
- <div class="divTableRow">
<div class="divTableCell">vganji</div>
<div class="divTableCell">Sai Ganji</div>
<div class="divTableCell">PPMC</div>
@@ -240,6 +235,16 @@
<div class="divTableCell">Raffael Marty</div>
<div class="divTableCell">PPMC</div>
</div>
+ <div class="divTableRow">
+ <div class="divTableCell">nathanael</div>
+ <div class="divTableCell">Nathanael Smith</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">moyete</div>
+ <div class="divTableCell">Moises Valdovinos</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
</div>
</div>
[incubator-spot] 38/45: Confluence References
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit ffdf3d69273a30e2fdf2dafd52dff5046a9fdac0
Author: Mark Schoeni <ms...@cloudera.com>
AuthorDate: Wed Aug 15 15:48:29 2018 -0500
Confluence References
Added link to the Confluence Spot Homepage to the menu and in the community page.
---
2016/03/index.html | 2 +-
2016/08/index.html | 2 +-
2016/09/index.html | 2 +-
2016/10/index.html | 2 +-
2017/03/index.html | 2 +-
_Tools/page-massedit.py | 89 +++++++++++++++++-----
blog/apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
blog/index.html | 2 +-
.../jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
category/cybersecurity/index.html | 2 +-
category/data-science/index.html | 2 +-
category/ipython-notebooks/index.html | 2 +-
category/security-analytics/index.html | 2 +-
category/threat-analysis-tools/index.html | 2 +-
category/uncategorized/index.html | 2 +-
community/committers/index.html | 2 +-
community/contribute/index.html | 2 +-
community/index.html | 15 ++--
doc/index.html | 2 +-
download/index.html | 2 +-
get-started/architecture/index.html | 2 +-
get-started/demo/index.html | 2 +-
get-started/environment/index.html | 2 +-
get-started/index.html | 2 +-
get-started/supporting-apache/index.html | 2 +-
index.html | 3 +-
project-components/ingestion/index.html | 2 +-
project-components/machine-learning/index.html | 2 +-
project-components/open-data-models/index.html | 2 +-
.../suspicious-connects-analysis/index.html | 2 +-
project-components/visualization/index.html | 2 +-
tag/github/index.html | 2 +-
tag/open-network-insight/index.html | 2 +-
tag/open-source/index.html | 2 +-
38 files changed, 115 insertions(+), 62 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index be7d987..1483d59 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/2016/08/index.html b/2016/08/index.html
index 300588a..1148290 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -95,7 +95,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/2016/09/index.html b/2016/09/index.html
index 589fab3..19a37e9 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/2016/10/index.html b/2016/10/index.html
index 599ac2a..af21429 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/2017/03/index.html b/2017/03/index.html
index 9d75d2d..f6e5297 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/_Tools/page-massedit.py b/_Tools/page-massedit.py
index c144e05..7514602 100644
--- a/_Tools/page-massedit.py
+++ b/_Tools/page-massedit.py
@@ -4,25 +4,25 @@ import massedit
import re
-print('Welcome to the regex page editor')
-print('Use this to make changes across all the Spot pages (mainly menus) fast')
-print('This is a result of laziness; enjoy')
+print('\nWelcome to the regex page editor')
+print('Use this to make changes across all the Spot pages fast (mainly menus)')
+print('This is a result of laziness; enjoy \n')
-def FindFiles(_rootDir, pattern: str):
+def FindFiles(_rootDir, _pattern: str):
_fileList = []
for root, dirs, files in os.walk(_rootDir):
- for file in fnmatch.filter(files, pattern):
+ for file in fnmatch.filter(files, _pattern):
_fileList.append(root + "\\" + file)
return _fileList
-def RegSearch(_searchPattern, files):
+def RegSearch(_searchPattern, _files):
filteredFiles = []
- for filePath in files:
+ for filePath in _files:
with open(filePath, "r", encoding='utf-8') as file:
for line in file:
pattern = re.compile(_searchPattern)
@@ -36,8 +36,8 @@ def RegSearch(_searchPattern, files):
return filteredFiles
-def RegDelLines(_searchPattern, files):
- for filePath in files:
+def RegDelLines(_searchPattern, _files):
+ for filePath in _files:
baseName = os.path.basename(filePath)
newFileName = os.path.dirname(filePath) + "\\" + baseName + ".new"
@@ -58,21 +58,74 @@ def RegDelLines(_searchPattern, files):
os.remove(filePath + ".old")
+def RegInsertAfter(_searchPattern, _files, _line2Insert, _insertType):
+ for filePath in _files:
+ baseName = os.path.basename(filePath)
+ newFileName = os.path.dirname(filePath) + "\\" + baseName + ".new"
+
+ with open(filePath, "r", encoding='utf-8') as oldFile:
+ # create swap file
+ with open(newFileName, "w", encoding='utf-8') as newFile:
+ for line in oldFile:
+ pattern = re.compile(_searchPattern)
+ matches = pattern.findall(line)
+
+ newFile.write(line)
+
+ if len(matches) > 0:
+ newFile.write(_line2Insert)
+
+
+ # Swap Files
+ os.rename(filePath, filePath + ".old")
+ os.rename(newFileName, filePath)
+ os.remove(filePath + ".old")
+
+
rootDir = "c:\\code\\incubator-spot" #input('enter directory:')
files = FindFiles(rootDir, 'index.html')
-searchPattern = "slack|SLACK|Slack" #input("Search Pattern:")
+searchPattern = input("Search Pattern:")
files = RegSearch(searchPattern, files)
-print("commands(DelLines / ...)")
-cmd = input("How to Proceed?: ")
+print("commands(DelLines / InsertAfter/ ...)")
+
+while True:
+ cmd = input("How to Proceed?: ")
+
+ # Delete Lines
+ if cmd.lower() == 'dellines':
+ RegDelLines(searchPattern, files)
+
+ # Insert After
+ elif cmd.lower() == 'insertafter':
+ insertType = input('append (app) or next line (nl)')
+
+ # normalise
+ if insertType in ['app', 'append']:
+ insertType = 'a'
+ elif insertType in ['next line', 'nl']:
+ insertType = 'n'
+
+ if insertType in ['a', 'n']:
+ line2Insert = input("What to insert: ")
+ RegInsertAfter(searchPattern, files, line2Insert, insertType)
+ else:
+ print("Invalid Insertion Type")
+
+ # Regex Replace
+ elif cmd == 'regex':
+ print("Not Implemented Yet")
+ #massedit.edit_files(files, ["re.sub()"])
+
+ # Quit
+ elif cmd in ['q', 'quit']:
+ break
-if cmd.lower() == 'dellines':
- RegDelLines(searchPattern, files)
-elif cmd == 'regex':
- print("Not Implemented Yet")
- #massedit.edit_files(files, ["re.sub()"])
+ # ?!?
+ else:
+ print("Invalid Command")
-print('Done')
\ No newline at end of file
+print('Bye')
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index 1e55797..cbd2850 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index b201c62..788e892 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index 99e90af..bc731bb 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 77c55d2..13fdf6a 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/blog/index.html b/blog/index.html
index cabfb33..39f30ec 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index abe2811..43de3c7 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 5c64896..7a339da 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index ecb702b..31de05a 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 998182a..0fe19db 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 3b244b6..51e3b78 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index 7c2cc4d..a2e1955 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index b4498ea..9873685 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 3c1c42f..2162e0e 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/community/committers/index.html b/community/committers/index.html
index bb78f2f..372b636 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index 75c8f92..d783655 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/community/index.html b/community/index.html
index 33bd9b1..10964e3 100755
--- a/community/index.html
+++ b/community/index.html
@@ -111,12 +111,9 @@
</li>
<li class="divider"></li>
<li class="dropmenu-head">Developer Resources</li>
- <li>
- <a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a>
- </li>
- <li>
- <a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a>
- </li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li>
<li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li>
@@ -189,8 +186,10 @@
<strong>Community Resources</strong>
<ul>
- <li>
- <a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a> - where users and committers will find tools and technical information to commit.</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a>
+ - where users and committers will find tools and technical information to commit.</li>
+ <li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a>
+ - where deevelopers will find project details such as roadmap, meeting notes, and other useful write-ups</li>
</ul>
</div>
diff --git a/doc/index.html b/doc/index.html
index 27d1aae..25f293f 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -77,7 +77,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/download/index.html b/download/index.html
index fba1178..97d0abb 100755
--- a/download/index.html
+++ b/download/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index 3ee0ade..cfaa07d 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
index 0431017..69376cf 100755
--- a/get-started/demo/index.html
+++ b/get-started/demo/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
index 6551afe..024a546 100755
--- a/get-started/environment/index.html
+++ b/get-started/environment/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/get-started/index.html b/get-started/index.html
index 1cb098f..f679152 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
index 8b83b43..fb00dae 100755
--- a/get-started/supporting-apache/index.html
+++ b/get-started/supporting-apache/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/index.html b/index.html
index bfa14d7..3151786 100755
--- a/index.html
+++ b/index.html
@@ -90,7 +90,8 @@
<li class="divider"></li>
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
- <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li>
<li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 902ca3b..83c6354 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index be20d01..27020fb 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 55090fb..1ce4d6c 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
index fe97bd9..a63af1c 100755
--- a/project-components/suspicious-connects-analysis/index.html
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index be34570..5417456 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/tag/github/index.html b/tag/github/index.html
index a13b4b2..e34eee6 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 3ce2e5d..32f6887 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 532a1a0..6fb5853 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -92,7 +92,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
+<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
</ul>
[incubator-spot] 27/45: Clarify statements regarding the use of CDH
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit ef57870d9751c83512133c536edc4e8e55f6cd51
Author: Austin Leahy <le...@apache.org>
AuthorDate: Thu Apr 27 19:31:34 2017 -0700
Clarify statements regarding the use of CDH
These changes have been made as a result of discussions on dev@spot.incubator.apache.org in the thread "Inappropriate web site"
---
doc/index.html | 47 ++++++++++++++++++++++++++++++-----------------
1 file changed, 30 insertions(+), 17 deletions(-)
diff --git a/doc/index.html b/doc/index.html
index 5c09b0d..39bf410 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -113,7 +113,7 @@
<a href="#environment">Environment <span class="icon-keyboard_arrow_right"></span></a>
<a href="#installation" class="sub-menu">Installation <span class="icon-keyboard_arrow_right"></span></a>
<ul>
- <li><a href="#cdh">CDH Requirements</a></li>
+ <li><a href="#requirements">Requirements</a></li>
<li><a href="#deployment">Deployment</a> </li>
<li><a href="#configuration">Configuration</a></li>
<li><a href="#ingest">Ingest</a></li>
@@ -156,7 +156,7 @@
<h1>Environment</h1>
<h3>Pure Hadoop</h3>
<p>
- Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the recommended deployment of CDH (see diagram below).<br><br>
+ Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of CDH (see diagram below).<br><br>
This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.<br><br>
</p>
@@ -185,9 +185,9 @@
<div class="main">
<div id="installation">
<h1>Installation</h1>
- <div id="cdh">
+ <div id="requirements">
- This installation guide assumes that a cluster with HDFS is running CDH.<br>
+ This version of the installation guide has been validated for clusters with HDFS running CDH.<br>
<h3>1. CDH (Cloudera Distribution of Hadoop) Requirements:</h3>
<p>
<strong>Minimum required version:</strong> 5.4<br>
@@ -518,7 +518,8 @@
<p class="terminal">
which screen
</p><br>
- <p class="short-mrg">If screen is not available, install it.</p>
+ <p class="short-mrg">If screen is not available, install it.</p>
+
<p class="terminal">
sudo yum install screen
</p><br>
@@ -555,7 +556,8 @@
scp -r spot-ml "ml-node":/home/"solution-user"/. ssh "ml-node"
mv spot-ml ml
cd /home/"solution-user"/ml
- </p>
+ </p>
+
<h4 class="gray">5.1 ML dependencies</h4>
<ul>
@@ -674,7 +676,8 @@
<p class="terminal">npm install –g browserify uglifyjs</p>
</li>
<li>
- <p class="short-mrg">Install dependencies and build Spot UI.</p>
+ <p class="short-mrg">Install dependencies and build Spot UI.</p>
+
<p class="terminal">npm install</p>
</li>
</ol>
@@ -717,11 +720,13 @@
<li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
</ul>
</p>
- <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Suspicious frame</strong>
+ <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Suspicious frame</strong>
+
<ol>
<li>
By selecting a specific row within the Suspicious frame, the connection in the Network View will be highlighted.<br><br>
- <img src="images/1.1_sc2.jpg" class="box-shadow" alt="" />
+ <img src="images/1.1_sc2.jpg" class="box-shadow" alt="" />
+
</li>
<li>
In addition, by performing this row selection the Details Frame presents all the Netflow records in between Source & Destination IP Addresses that happened in the same minute as the Suspicious Record selected<br><br>
@@ -746,7 +751,8 @@
<ol>
<li>
<p class="short-mrg">As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.</p>
- <img src="images/1.1_sc7.jpg" class="box-shadow" alt="" />
+ <img src="images/1.1_sc7.jpg" class="box-shadow" alt="" />
+
</li>
<li>
<p class="short-mrg">A primary mouse click over one of the nodes will bring a chord diagram into the Details frame.</p>
@@ -846,7 +852,8 @@
<h4 class="gray">Save Comments</h4>
<p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
<p class="short-mrg">Click on the Save button after entering the data to write it into a CSV file, which eventually will be used in the Storyboard Analyst View.</p>
- <img src="images/1.1_ti03.jpg" class="box-shadow" alt="" />
+ <img src="images/1.1_ti03.jpg" class="box-shadow" alt="" />
+
<p class="short-mrg">After creating the csv file with the analysis description, the following functions will generate all graphs and diagrams related to the IP under investigation, to populate the Storyboard Analyst view.</p>
<ul>
@@ -867,7 +874,8 @@
<p><strong>details_inbound()</strong> - This function executes a query to the flow table, to find additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br>
<strong>Output:</strong> sbdet-<ip>.tsv</p>
- <p><strong>add_threat()</strong> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed. This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br><strong>Output:</strong> threats.csv</p>
+ <p><strong>add_threat()</strong> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed. This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br><strong>Output:</strong> threats.csv</p>
+
<p>Each function will print a message to let you know if its output file was successfully updated.</p>
@@ -914,7 +922,8 @@
<p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
<p class="short-mrg"><strong>Data source file:</strong> threats.csv Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and the additional information will be displayed.</p>
- <p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.JPG" class="box-shadow" alt="" /></p>
+ <p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.JPG" class="box-shadow" alt="" /></p>
+
<p class="short-mrg">Clicking on a threat from the list will also update the additional frames.</p>
@@ -1060,7 +1069,8 @@
<p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the dns table, looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following criteria:</p>
<p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular Domain Name</p>
- <p class="short-mrg">The query results will provide the different unique IP Addresses list that have queried this particular Domain, the list will be sorted by the quantity of connections.</p>
+ <p class="short-mrg">The query results will provide the different unique IP Addresses list that have queried this particular Domain, the list will be sorted by the quantity of connections.</p>
+
<p style="text-align:center;"><img src="images/1.1_dns_ti03.jpg" class="box-shadow" alt="" /></p>
<p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular IP</p>
@@ -1127,7 +1137,8 @@
<div id="uproxy">
<h3 style="margin-bottom: 0;">Proxy</h3>
<div id="psc">
- <h4 class="gray">Suspicious Proxy</h4>
+ <h4 class="gray">Suspicious Proxy</h4>
+
<strong>Walk-through</strong>
<ol>
<li>
@@ -1226,7 +1237,8 @@
<li>LUSER</li>
</ul>
- <p>For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
+ <p>For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
+
<p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
@@ -1314,7 +1326,8 @@
<p class="short-mrg"><strong>Data source file:</strong> timeline-{id}.tsv<br>Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll. The number next to the IP Address represents the quantity of [...]
<img src="images/1.1_proxy_sb05.jpg" class="box-shadow" alt="" /><br><br>
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
+
<ul>
<li>threats.csv</li>
<li>incident-progression-{id}.json</li>
[incubator-spot] 13/45: Updating images an links to Social channels
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 198c0309839fce9690fdd163fffb0f665c13f75b
Author: Cesar <ce...@apache.org>
AuthorDate: Thu Oct 20 15:26:08 2016 -0500
Updating images an links to Social channels
---
2016/03/index.html | 0
2016/08/index.html | 0
2016/09/index.html | 0
blog/index.html | 0
category/cybersecurity/feed/index.html | 0
category/cybersecurity/index.html | 0
category/data-science/feed/index.html | 0
category/data-science/index.html | 0
category/ipython-notebooks/feed/index.html | 0
category/ipython-notebooks/index.html | 0
category/security-analytics/feed/index.html | 0
category/security-analytics/index.html | 0
category/threat-analysis-tools/feed/index.html | 0
category/threat-analysis-tools/index.html | 0
category/uncategorized/feed/index.html | 0
category/uncategorized/index.html | 0
comments/feed/index.html | 0
feed/index.html | 0
index.html | 2 +-
tag/github/feed/index.html | 0
tag/github/index.html | 0
tag/open-network-insight/feed/index.html | 0
tag/open-network-insight/index.html | 0
tag/open-source/feed/index.html | 0
tag/open-source/index.html | 0
wp-content/themes/oni/favicon.ico | Bin
wp-content/themes/oni/favicon.png | Bin
wp-content/themes/oni/library/css/meanmenu.css | 0
wp-content/themes/oni/library/css/style.css | 0
wp-content/themes/oni/library/fonts/icomoon.eot | Bin
wp-content/themes/oni/library/fonts/icomoon.svg | 0
wp-content/themes/oni/library/fonts/icomoon.ttf | Bin
wp-content/themes/oni/library/fonts/icomoon.woff | Bin
.../themes/oni/library/images/add-to-slack.png | Bin 3789 -> 3457 bytes
wp-content/themes/oni/library/images/and.png | Bin
.../themes/oni/library/images/apache-incubator.png | Bin
.../themes/oni/library/images/apple-touch-icon.png | Bin
.../themes/oni/library/images/key_features_bg.jpg | Bin
wp-content/themes/oni/library/images/logo.png | Bin
.../themes/oni/library/images/masthead-bg.png | Bin
.../themes/oni/library/images/quote-person.png | Bin
wp-content/themes/oni/library/images/quotes.png | Bin
wp-content/themes/oni/library/images/search.png | Bin
.../themes/oni/library/images/win8-tile-icon.png | Bin
wp-content/themes/oni/library/js/jquery.meanmenu.js | 0
.../oni/library/js/libs/modernizr.custom.min.js | 0
wp-content/themes/oni/library/js/scripts.js | 0
wp-content/uploads/2016/03/FloCon2015-300x225.png | Bin
wp-content/uploads/2016/03/FloCon2015-768x576.png | Bin
wp-content/uploads/2016/03/FloCon2015.png | Bin
.../uploads/2016/03/SPOT_Collabration-Icon_v2.png | Bin
.../uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png | Bin
wp-content/uploads/2016/03/advantages-1-300x136.png | Bin
wp-content/uploads/2016/03/advantages-1-768x347.png | Bin
wp-content/uploads/2016/03/advantages-1.png | Bin
wp-content/uploads/2016/03/connects.png | Bin
wp-content/uploads/2016/03/how-it-works.png | Bin 52599 -> 52204 bytes
wp-content/uploads/2016/03/magnify-icon.png | Bin
wp-content/uploads/2016/03/spot470.png | Bin
wp-content/uploads/2016/03/storyboard-icon.png | Bin
wp-content/uploads/2016/03/threat-icon.png | Bin
.../ONI_Architecture-Diagram_1300_v4-1024x532.png | Bin
.../09/ONI_Architecture-Diagram_1300_v4-300x156.png | Bin
.../09/ONI_Architecture-Diagram_1300_v4-768x399.png | Bin
.../2016/09/ONI_Architecture-Diagram_1300_v4.png | Bin
.../09/ONI_Architecture-Diagram_1300_v4_old.png | Bin
wp-content/uploads/2016/10/iPython-1-300x89.png | Bin
wp-content/uploads/2016/10/iPython-1.png | Bin
wp-includes/js/comment-reply.min.js | 0
wp-includes/js/jquery/jquery-migrate.min.js | 0
wp-includes/js/jquery/jquery.js | 0
wp-includes/js/wp-embed.min.js | 0
wp-json/index.html | 0
73 files changed, 1 insertion(+), 1 deletion(-)
diff --git a/2016/03/index.html b/2016/03/index.html
old mode 100644
new mode 100755
diff --git a/2016/08/index.html b/2016/08/index.html
old mode 100644
new mode 100755
diff --git a/2016/09/index.html b/2016/09/index.html
old mode 100644
new mode 100755
diff --git a/blog/index.html b/blog/index.html
old mode 100644
new mode 100755
diff --git a/category/cybersecurity/feed/index.html b/category/cybersecurity/feed/index.html
old mode 100644
new mode 100755
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
old mode 100644
new mode 100755
diff --git a/category/data-science/feed/index.html b/category/data-science/feed/index.html
old mode 100644
new mode 100755
diff --git a/category/data-science/index.html b/category/data-science/index.html
old mode 100644
new mode 100755
diff --git a/category/ipython-notebooks/feed/index.html b/category/ipython-notebooks/feed/index.html
old mode 100644
new mode 100755
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
old mode 100644
new mode 100755
diff --git a/category/security-analytics/feed/index.html b/category/security-analytics/feed/index.html
old mode 100644
new mode 100755
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
old mode 100644
new mode 100755
diff --git a/category/threat-analysis-tools/feed/index.html b/category/threat-analysis-tools/feed/index.html
old mode 100644
new mode 100755
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
old mode 100644
new mode 100755
diff --git a/category/uncategorized/feed/index.html b/category/uncategorized/feed/index.html
old mode 100644
new mode 100755
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
old mode 100644
new mode 100755
diff --git a/comments/feed/index.html b/comments/feed/index.html
old mode 100644
new mode 100755
diff --git a/feed/index.html b/feed/index.html
old mode 100644
new mode 100755
diff --git a/index.html b/index.html
old mode 100644
new mode 100755
index 360738c..b7c146b
--- a/index.html
+++ b/index.html
@@ -405,7 +405,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://open-network-insight.org:3000/" target="_blank"><img src="wp-content/themes/oni/library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="wp-content/themes/oni/library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/tag/github/feed/index.html b/tag/github/feed/index.html
old mode 100644
new mode 100755
diff --git a/tag/github/index.html b/tag/github/index.html
old mode 100644
new mode 100755
diff --git a/tag/open-network-insight/feed/index.html b/tag/open-network-insight/feed/index.html
old mode 100644
new mode 100755
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
old mode 100644
new mode 100755
diff --git a/tag/open-source/feed/index.html b/tag/open-source/feed/index.html
old mode 100644
new mode 100755
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/favicon.ico b/wp-content/themes/oni/favicon.ico
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/favicon.png b/wp-content/themes/oni/favicon.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/css/meanmenu.css b/wp-content/themes/oni/library/css/meanmenu.css
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/css/style.css b/wp-content/themes/oni/library/css/style.css
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/fonts/icomoon.eot b/wp-content/themes/oni/library/fonts/icomoon.eot
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/fonts/icomoon.svg b/wp-content/themes/oni/library/fonts/icomoon.svg
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/fonts/icomoon.ttf b/wp-content/themes/oni/library/fonts/icomoon.ttf
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/fonts/icomoon.woff b/wp-content/themes/oni/library/fonts/icomoon.woff
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/add-to-slack.png b/wp-content/themes/oni/library/images/add-to-slack.png
old mode 100644
new mode 100755
index 93649ed..6e1f1d8
Binary files a/wp-content/themes/oni/library/images/add-to-slack.png and b/wp-content/themes/oni/library/images/add-to-slack.png differ
diff --git a/wp-content/themes/oni/library/images/and.png b/wp-content/themes/oni/library/images/and.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/apache-incubator.png b/wp-content/themes/oni/library/images/apache-incubator.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/apple-touch-icon.png b/wp-content/themes/oni/library/images/apple-touch-icon.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/key_features_bg.jpg b/wp-content/themes/oni/library/images/key_features_bg.jpg
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/logo.png b/wp-content/themes/oni/library/images/logo.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/masthead-bg.png b/wp-content/themes/oni/library/images/masthead-bg.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/quote-person.png b/wp-content/themes/oni/library/images/quote-person.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/quotes.png b/wp-content/themes/oni/library/images/quotes.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/search.png b/wp-content/themes/oni/library/images/search.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/images/win8-tile-icon.png b/wp-content/themes/oni/library/images/win8-tile-icon.png
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/js/jquery.meanmenu.js b/wp-content/themes/oni/library/js/jquery.meanmenu.js
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/js/libs/modernizr.custom.min.js b/wp-content/themes/oni/library/js/libs/modernizr.custom.min.js
old mode 100644
new mode 100755
diff --git a/wp-content/themes/oni/library/js/scripts.js b/wp-content/themes/oni/library/js/scripts.js
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/FloCon2015-300x225.png b/wp-content/uploads/2016/03/FloCon2015-300x225.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/FloCon2015-768x576.png b/wp-content/uploads/2016/03/FloCon2015-768x576.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/FloCon2015.png b/wp-content/uploads/2016/03/FloCon2015.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png b/wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png b/wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/advantages-1-300x136.png b/wp-content/uploads/2016/03/advantages-1-300x136.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/advantages-1-768x347.png b/wp-content/uploads/2016/03/advantages-1-768x347.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/advantages-1.png b/wp-content/uploads/2016/03/advantages-1.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/connects.png b/wp-content/uploads/2016/03/connects.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/how-it-works.png b/wp-content/uploads/2016/03/how-it-works.png
old mode 100644
new mode 100755
index 798ac8f..393db59
Binary files a/wp-content/uploads/2016/03/how-it-works.png and b/wp-content/uploads/2016/03/how-it-works.png differ
diff --git a/wp-content/uploads/2016/03/magnify-icon.png b/wp-content/uploads/2016/03/magnify-icon.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/spot470.png b/wp-content/uploads/2016/03/spot470.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/storyboard-icon.png b/wp-content/uploads/2016/03/storyboard-icon.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/03/threat-icon.png b/wp-content/uploads/2016/03/threat-icon.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-1024x532.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-1024x532.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-768x399.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-768x399.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4_old.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4_old.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/10/iPython-1-300x89.png b/wp-content/uploads/2016/10/iPython-1-300x89.png
old mode 100644
new mode 100755
diff --git a/wp-content/uploads/2016/10/iPython-1.png b/wp-content/uploads/2016/10/iPython-1.png
old mode 100644
new mode 100755
diff --git a/wp-includes/js/comment-reply.min.js b/wp-includes/js/comment-reply.min.js
old mode 100644
new mode 100755
diff --git a/wp-includes/js/jquery/jquery-migrate.min.js b/wp-includes/js/jquery/jquery-migrate.min.js
old mode 100644
new mode 100755
diff --git a/wp-includes/js/jquery/jquery.js b/wp-includes/js/jquery/jquery.js
old mode 100644
new mode 100755
diff --git a/wp-includes/js/wp-embed.min.js b/wp-includes/js/wp-embed.min.js
old mode 100644
new mode 100755
diff --git a/wp-json/index.html b/wp-json/index.html
old mode 100644
new mode 100755
[incubator-spot] 35/45: Changes on Documentation section to reflect
latest changes for Spot 1.0 release
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 9147a169c1934ee30329be5473f79b80f8f8e9de
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Thu Sep 7 01:04:35 2017 -0500
Changes on Documentation section to reflect latest changes for Spot 1.0 release
---
community/committers/index.html | 6 +-
doc/images/DNS_1.png | Bin 0 -> 213372 bytes
doc/images/DNS_2.png | Bin 0 -> 24963 bytes
doc/images/DNS_3.png | Bin 0 -> 26479 bytes
doc/images/DNS_4.png | Bin 0 -> 42742 bytes
doc/images/DNS_5.png | Bin 0 -> 83147 bytes
doc/images/DNS_6.png | Bin 0 -> 40316 bytes
doc/images/Flow_1.png | Bin 0 -> 32092 bytes
doc/images/Flow_2.png | Bin 0 -> 54099 bytes
doc/images/Proxy_1.png | Bin 0 -> 204763 bytes
doc/images/Proxy_10.png | Bin 0 -> 62762 bytes
doc/images/Proxy_11.png | Bin 0 -> 203529 bytes
doc/images/Proxy_12.png | Bin 0 -> 41439 bytes
doc/images/Proxy_12_previous.png | Bin 0 -> 42153 bytes
doc/images/Proxy_13.png | Bin 0 -> 73281 bytes
doc/images/Proxy_15.png | Bin 0 -> 41171 bytes
doc/images/Proxy_16.png | Bin 0 -> 51983 bytes
doc/images/Proxy_17.png | Bin 0 -> 15400 bytes
doc/images/Proxy_18.png | Bin 0 -> 86614 bytes
doc/images/Proxy_19.png | Bin 0 -> 240292 bytes
doc/images/Proxy_2.png | Bin 0 -> 38475 bytes
doc/images/Proxy_3.png | Bin 0 -> 48316 bytes
doc/images/Proxy_4.png | Bin 0 -> 236020 bytes
doc/images/Proxy_5.png | Bin 0 -> 68078 bytes
doc/images/Proxy_6.png | Bin 0 -> 130178 bytes
doc/images/Proxy_7.png | Bin 0 -> 53197 bytes
doc/images/Proxy_8.png | Bin 0 -> 64058 bytes
doc/images/Proxy_9.png | Bin 0 -> 102913 bytes
doc/index.html | 68 ++++++++++-----------
download/index.html | 21 +------
get-started/architecture/index.html | 2 +-
library/images/architecture.png | Bin 228333 -> 66295 bytes
library/images/architecture_lrg.png | Bin 0 -> 128136 bytes
.../{architecture.png => architecture_old.png} | Bin
34 files changed, 39 insertions(+), 58 deletions(-)
diff --git a/community/committers/index.html b/community/committers/index.html
index 8e80331..7bbe6f5 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -300,14 +300,14 @@
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
- <div class="divTableCell"></div>
+ <div class="divTableCell">brandonedwards</div>
<div class="divTableCell">Brandon Edwards</div>
<div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
- <div class="divTableCell"></div>
- <div class="divTableCell">Gustavo Lujan</div>
+ <div class="divTableCell">lujangus</div>
+ <div class="divTableCell">Gustavo A. Lujan-Moreno</div>
<div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
diff --git a/doc/images/DNS_1.png b/doc/images/DNS_1.png
new file mode 100755
index 0000000..5c1dfe3
Binary files /dev/null and b/doc/images/DNS_1.png differ
diff --git a/doc/images/DNS_2.png b/doc/images/DNS_2.png
new file mode 100755
index 0000000..229ac26
Binary files /dev/null and b/doc/images/DNS_2.png differ
diff --git a/doc/images/DNS_3.png b/doc/images/DNS_3.png
new file mode 100755
index 0000000..01c77d7
Binary files /dev/null and b/doc/images/DNS_3.png differ
diff --git a/doc/images/DNS_4.png b/doc/images/DNS_4.png
new file mode 100755
index 0000000..9c43e6d
Binary files /dev/null and b/doc/images/DNS_4.png differ
diff --git a/doc/images/DNS_5.png b/doc/images/DNS_5.png
new file mode 100755
index 0000000..76a838e
Binary files /dev/null and b/doc/images/DNS_5.png differ
diff --git a/doc/images/DNS_6.png b/doc/images/DNS_6.png
new file mode 100755
index 0000000..ed126d7
Binary files /dev/null and b/doc/images/DNS_6.png differ
diff --git a/doc/images/Flow_1.png b/doc/images/Flow_1.png
new file mode 100755
index 0000000..a97d86d
Binary files /dev/null and b/doc/images/Flow_1.png differ
diff --git a/doc/images/Flow_2.png b/doc/images/Flow_2.png
new file mode 100755
index 0000000..94faa0c
Binary files /dev/null and b/doc/images/Flow_2.png differ
diff --git a/doc/images/Proxy_1.png b/doc/images/Proxy_1.png
new file mode 100755
index 0000000..dda10f4
Binary files /dev/null and b/doc/images/Proxy_1.png differ
diff --git a/doc/images/Proxy_10.png b/doc/images/Proxy_10.png
new file mode 100755
index 0000000..89148ea
Binary files /dev/null and b/doc/images/Proxy_10.png differ
diff --git a/doc/images/Proxy_11.png b/doc/images/Proxy_11.png
new file mode 100755
index 0000000..44179d7
Binary files /dev/null and b/doc/images/Proxy_11.png differ
diff --git a/doc/images/Proxy_12.png b/doc/images/Proxy_12.png
new file mode 100755
index 0000000..0240f16
Binary files /dev/null and b/doc/images/Proxy_12.png differ
diff --git a/doc/images/Proxy_12_previous.png b/doc/images/Proxy_12_previous.png
new file mode 100755
index 0000000..cfd6735
Binary files /dev/null and b/doc/images/Proxy_12_previous.png differ
diff --git a/doc/images/Proxy_13.png b/doc/images/Proxy_13.png
new file mode 100755
index 0000000..405319c
Binary files /dev/null and b/doc/images/Proxy_13.png differ
diff --git a/doc/images/Proxy_15.png b/doc/images/Proxy_15.png
new file mode 100755
index 0000000..436b57a
Binary files /dev/null and b/doc/images/Proxy_15.png differ
diff --git a/doc/images/Proxy_16.png b/doc/images/Proxy_16.png
new file mode 100755
index 0000000..809aff9
Binary files /dev/null and b/doc/images/Proxy_16.png differ
diff --git a/doc/images/Proxy_17.png b/doc/images/Proxy_17.png
new file mode 100755
index 0000000..f83fc90
Binary files /dev/null and b/doc/images/Proxy_17.png differ
diff --git a/doc/images/Proxy_18.png b/doc/images/Proxy_18.png
new file mode 100755
index 0000000..74521b3
Binary files /dev/null and b/doc/images/Proxy_18.png differ
diff --git a/doc/images/Proxy_19.png b/doc/images/Proxy_19.png
new file mode 100755
index 0000000..1a28eab
Binary files /dev/null and b/doc/images/Proxy_19.png differ
diff --git a/doc/images/Proxy_2.png b/doc/images/Proxy_2.png
new file mode 100755
index 0000000..e573643
Binary files /dev/null and b/doc/images/Proxy_2.png differ
diff --git a/doc/images/Proxy_3.png b/doc/images/Proxy_3.png
new file mode 100755
index 0000000..e4f66a6
Binary files /dev/null and b/doc/images/Proxy_3.png differ
diff --git a/doc/images/Proxy_4.png b/doc/images/Proxy_4.png
new file mode 100755
index 0000000..a07d801
Binary files /dev/null and b/doc/images/Proxy_4.png differ
diff --git a/doc/images/Proxy_5.png b/doc/images/Proxy_5.png
new file mode 100755
index 0000000..f257386
Binary files /dev/null and b/doc/images/Proxy_5.png differ
diff --git a/doc/images/Proxy_6.png b/doc/images/Proxy_6.png
new file mode 100755
index 0000000..11bc64b
Binary files /dev/null and b/doc/images/Proxy_6.png differ
diff --git a/doc/images/Proxy_7.png b/doc/images/Proxy_7.png
new file mode 100755
index 0000000..4289515
Binary files /dev/null and b/doc/images/Proxy_7.png differ
diff --git a/doc/images/Proxy_8.png b/doc/images/Proxy_8.png
new file mode 100755
index 0000000..4c11c74
Binary files /dev/null and b/doc/images/Proxy_8.png differ
diff --git a/doc/images/Proxy_9.png b/doc/images/Proxy_9.png
new file mode 100755
index 0000000..e5366a9
Binary files /dev/null and b/doc/images/Proxy_9.png differ
diff --git a/doc/index.html b/doc/index.html
index 9e5bf95..7efd4ca 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -667,7 +667,7 @@
</li>
<li>
<p class="short-mrg">With root privileges, install browserify and uglify as global commands on your system.</p>
- <p class="terminal">npm install –g browserify uglifyjs</p>
+ <p class="terminal">npm install –g browserify uglify-js</p>
</li>
<li>
<p class="short-mrg">Install dependencies and build Spot UI.</p>
@@ -756,7 +756,7 @@
</li>
</ol>
- <h4 class="gray">The Notebook frame</h4>
+ <h4 class="gray">Scoring Frame</h4>
<p class="short-mrg">This frame contains a section where the analyst can score IP Addresses and Ports with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, therefore if the analyst
wishes to score all connections with one same relevant attribute (i.e. src port 80), then select only the combo boxes that are relevant and leave the rest at the first row at the top.</p>
<img src="images/1.1_sc10.png" class="box-shadow" alt="" />
@@ -843,14 +843,14 @@
</li>
<li>
<p class="short-mrg">Your view should look something like this, depending on the IP's you have analyzed on the Threat Analysis for that day. You can select a different date from the calendar.</p>
- <img src="images/flow_sb_1.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_4.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Review the results:</p>
<p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
<p class="short-mrg">Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and the additional information will be displayed.</p>
- <p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.jpg" class="box-shadow" alt="" /></p>
+ <p class="short-mrg" style="text-align: center"><img src="images/DNS_5.png" class="box-shadow" alt="" /></p>
<p class="short-mrg">Clicking on a threat from the list will also update the additional frames.</p>
@@ -890,11 +890,11 @@
<ol>
<li>
<p class="short-mrg">Load the Ingest Summary page by going to <strong>http://"server-ip":8889/files/index_ingest.html</strong> or using the drop down menu.</p>
- <img src="images/is1.png" class="box-shadow" alt="" />
+ <img src="images/Flow_1.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days. Your view should now look like this:</p>
- <img src="images/is2.png" class="box-shadow" alt="" />
+ <img src="images/Flow_2.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Ingest Summary presents the Flows ingestion timeline, showing the total flows for a particular period of time.</p>
@@ -915,7 +915,7 @@
<h4 class="gray" style="margin-top:0;">Suspicious DNS</h4>
<p><strong>Open the analyst view for Suspicious DNS:</strong> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).</p>
<p class="short-mrg">Your screen should now look like this:</p>
- <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_1.png" class="box-shadow" alt="" />
<p class="short-mrg">Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
@@ -951,7 +951,7 @@
<li><strong>Dendrogram diagram (when you select an IP address in the Network View frame)</strong></li>
</ul>
- <p><strong>The Notebook Scoring Frame</strong><br>The main function in this frame is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific
+ <p><strong>Scoring Frame</strong><br>The main function in this frame is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific
connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow
down the coincidences, therefore if the analyst wishes to score all connections with one same relevant attribute (i.e. ip address 10.1.1.1), then select only the combo boxes that are relevant and leave the rest at the first row at
the top.</p>
@@ -972,14 +972,14 @@
<h4 class="gray">DNS Threat Investigation</h4>
<p>Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.</p>
<p class="short-mrg">Your view should now look like this:</p>
- <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_1.png" class="box-shadow" alt="" />
<p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.</p>
<p class="short-mrg">Select <strong>DNS > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/1.1_dns_ti01.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_2.png" class="box-shadow" alt="" />
<p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all IPs and DNS Names scored as High risk will be presented</p>
- <img src="images/1.1_dns_ti02.png" class="box-shadow" alt="" />
+ <img src="images/DNS_3.png" class="box-shadow" alt="" />
<p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
<p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the dns table, looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following
@@ -1013,11 +1013,11 @@
<ol>
<li>
<p>Select the option <strong>DNS > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/dns_sb_tit1.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_6.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Your view should look something like this, pending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
- <img src="images/1.1_dns_sb01.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_4.png" class="box-shadow" alt="" />
</li>
</ol>
<p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
@@ -1026,7 +1026,7 @@
<p class="short-mrg">Incident progression frame is located on the right side of the Web page.</p>
- <img src="images/1.1_dns_sb02.jpg" class="box-shadow" alt="" />
+ <img src="images/DNS_5.png" class="box-shadow" alt="" />
<p class="short-mrg">This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
</p>
@@ -1042,7 +1042,7 @@
<li>
<p class="short-mrg"><strong>Open the analyst view for Suspicious Proxy:</strong> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>. Select the date that you want to review (defaults to current date).</p>
<p class="short-mrg">Your screen should now look like this:</p>
- <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" /><br><br>
+ <img src="images/Proxy_1.png" class="box-shadow" alt="" /><br><br>
<p class="short-mrg">Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
<ul>
@@ -1054,7 +1054,7 @@
</li>
<li>
- <p class="short-mrg"><strong>The Suspicious frame</strong><br>Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.</p>
+ <p class="short-mrg"><strong>Suspicious Frame</strong><br>Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.</p>
<ol>
<li>
@@ -1086,31 +1086,31 @@
<ol>
<li>
<p class="short-mrg">As soon as you move your mouse over a node, a dialog shows up providing additional information.</p>
- <img src="images/1.1_proxy_sc02.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_2.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Graph can be zoomed in/out and can be moved in the frame</p>
- <img src="images/1.1_proxy_sc03.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_3.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">By double-clicking in the Root Proxy Node the graph can be fully expanded/collapsed</p>
- <img src="images/1.1_proxy_sc04.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_4.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">By double-clicking a node, the node can be expanded/collapsed one level</p>
- <img src="images/1.1_proxy_sc05.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_5.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">The path in yellow represents the Suspicious record selected in the suspicious frame</p>
- <img src="images/1.1_proxy_sc06.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_6.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Records will be highlighted with different colors depending upon the Risk Reputation provided by the Reputation Service</p>
- <img src="images/1.1_proxy_sc07.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_7.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames </p>
- <img src="images/1.1_proxy_sc08.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_8.png" class="box-shadow" alt="" />
</li>
</ol>
</li>
@@ -1118,12 +1118,12 @@
<p class="short-mrg" style="margin-bottom:0;"><strong>The Details frame</strong></p>
<p class="short-mrg">Located at the bottom of the Web page. It provides additional information for the selected connection in the Suspicious frame. It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type,
Proxy Server IP, Bytes.</p>
- <img src="images/1.1_proxy_sc09.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_9.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg"><strong>The Scoring frame</strong><br> This frame contains a section where the Analyst can score Proxy records with different values. In order to assign a risk to a specific connection,
select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.</p>
- <img src="images/1.1_proxy_sc10.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_10.png" class="box-shadow" alt="" />
</li>
</ol>
@@ -1142,21 +1142,21 @@
<p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
<p class="short-mrg">Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review.</p>
<p class="short-mrg">Your view should now look like this:</p>
- <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_11.png" class="box-shadow" alt="" />
<p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.</p>
<p class="short-mrg">Select <strong>Proxy > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/1.1_proxy_ti01.jpg" class="box-shadow" alt="" /><br><br>
+ <img src="images/Proxy_12_previous.png" class="box-shadow" alt="" /><br><br>
<p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all Proxy Records scored as High risk will be presented</p>
- <img src="images/1.1_proxy_ti02.jpg" class="box-shadow" alt="" /><br><br>
+ <img src="images/Proxy_12.png" class="box-shadow" alt="" /><br><br>
<p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
<p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the proxy table, looking into the raw data initially collected to find additional activity for the selected Proxy Record. Results will be
extracted and displayed as a table in the UI. The quantity of results displayed on screen can be set by modifying the top_results
variable, additional information on how to modify this variable can be found <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/proxy/ipynb_templates/ThreatInvestigation.md"> here</a></p>
- <img src="images/1.1_proxy_ti03.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_13.png" class="box-shadow" alt="" />
<p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
<p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.</p>
<img src="images/1.1_proxy_ti04.jpg" class="box-shadow" alt="" />
@@ -1172,18 +1172,18 @@
<ol>
<li>
Select the option <strong>Proxy > Storyboard</strong> from Apache Spot (incubating) Menu.<br><br>
- <img src="images/1.1_proxy_sb01.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_15.png" class="box-shadow" alt="" />
</li>
<li>
<p class="short-mrg">Your view should look something like this, depending on how many threats you have analyzed and commented on the Threat Investigation page for that day. You can select a different date from the calendar.</p>
- <img src="images/1.1_proxy_sb02.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_16.png" class="box-shadow" alt="" />
</li>
</ol>
<p class="orange-bold">Executive Threat Briefing</p>
<p class="short-mrg">Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the comments at the bottom area of the panel.</p>
- <p style="text-align: center;"><img src="images/1.1_proxy_sb03.jpg" class="box-shadow" alt="" /></p>
+ <p style="text-align: center;"><img src="images/Proxy_17.png" class="box-shadow" alt="" /></p>
<p class="orange-bold" style="margin-bottom:0;">Incident progression</p>
<p class="short-mrg"><strong>Data source file:</strong> incident-progression-{id}.json<br>Incident progression frame is located on the right side of the Web page. Incident Progression displays a tree graph (dendrogram) detailing the type of connections that
@@ -1196,10 +1196,10 @@
<li><strong>Threat</strong> - Represents the Suspicious Proxy Record</li>
<li><strong>Referred</strong> - URLs that the Suspicious Proxy Record referred to</li>
</ul>
- <img src="images/1.1_proxy_sb04.jpg" class="box-shadow" alt="" />
+ <img src="images/Proxy_18.png" class="box-shadow" alt="" />
<p class="short-mrg">If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.</p>
- <img src="images/1.1_proxy_sb06.jpg" class="box-shadow" alt="" /><br><br>
+ <img src="images/proxy_19.png" class="box-shadow" alt="" /><br><br>
<p class="orange-bold" style="margin-bottom:0;">Timeline</p>
<p class="short-mrg">Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing
diff --git a/download/index.html b/download/index.html
index 4428f34..58bedfb 100755
--- a/download/index.html
+++ b/download/index.html
@@ -163,26 +163,7 @@
<p>For more instructions about how to install each module please read below instructions.</p>
<ul>
- <li>You should see the content of the folder:
- <span class="indent">
- spotadmin-mac01:apache-spot-1.0-incubating spotadmin$ ls -la<br />
- total 72<br />
- drwxr-xr-x 14 spotadmin staff 476 Jul 24 16:45 .<br />
- drwxr-xr-x 7 spotadmin staff 238 Aug 4 09:32 ..<br />
- -rw-r--r-- 1 spotadmin staff 20 Jul 24 16:45 .gitignore<br />
- -rw-r--r-- 1 spotadmin staff 0 Jul 24 16:45 .gitmodules<br />
- -rw-r--r-- 1 spotadmin staff 560 Jul 24 16:45 DISCLAIMER<br />
- -rw-r--r-- 1 spotadmin staff 11918 Jul 24 16:45 LICENSE<br />
- -rw-r--r-- 1 spotadmin staff 1493 Jul 24 16:45 LICENSE-topojson.txt<br />
- -rw-r--r-- 1 spotadmin staff 159 Jul 24 16:45 NOTICE<br />
- -rw-r--r-- 1 spotadmin staff 6761 Jul 24 16:45 README.md<br />
- drwxr-xr-x 3 spotadmin staff 102 Jul 24 16:45 docs<br />
- drwxr-xr-x 10 spotadmin staff 340 Jul 24 16:45 spot-ingest<br />
- drwxr-xr-x 13 spotadmin staff 442 Jul 24 16:45 spot-ml<br />
- drwxr-xr-x 11 spotadmin staff 374 Jul 24 16:45 spot-oa<br />
- drwxr-xr-x 10 spotadmin staff 340 Jul 24 16:45 spot-setup
- </span>
- </li>
+ <li>You should see the content of the folder</li>
<li>Decompressed tarball content should be the same with the content located in:<br />
<a href="https://github.com/apache/incubator-spot/tree/v1.0-incubating" target="_blank">https://github.com/apache/incubator-spot/tree/v1.0-incubating</a>
</li>
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index e821436..2a3a93e 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -136,7 +136,7 @@
<hr />
<p class="center">
- <img src="../../library/images/architecture.png" alt="Product Architechture" />
+ <a href="../../library/images/architecture_lrg.png"><img src="../../library/images/architecture.png" alt="Product Architechture" /></a>
</p>
</div><!--/.wrap-->
diff --git a/library/images/architecture.png b/library/images/architecture.png
index 602045a..a581b55 100755
Binary files a/library/images/architecture.png and b/library/images/architecture.png differ
diff --git a/library/images/architecture_lrg.png b/library/images/architecture_lrg.png
new file mode 100755
index 0000000..f7bfc38
Binary files /dev/null and b/library/images/architecture_lrg.png differ
diff --git a/library/images/architecture.png b/library/images/architecture_old.png
similarity index 100%
copy from library/images/architecture.png
copy to library/images/architecture_old.png
[incubator-spot] 45/45: Merge pull request #147 from schonz/asf-site
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit dacbb29d67eeab92934060ea542fedd020ef3946
Merge: 92b0192 0081dcc
Author: Austin Leahy <le...@apache.org>
AuthorDate: Tue Sep 10 18:39:24 2019 -0700
Merge pull request #147 from schonz/asf-site
[SPOT-277] Updates to Spot Website
.gitignore | 1 +
2016/03/index.html | 5 +-
2016/08/index.html | 5 +-
2016/09/index.html | 5 +-
2016/10/index.html | 5 +-
2017/03/index.html | 5 +-
README.md | 126 +++++
_Tools/page-massedit.py | 171 +++++++
apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-3-most-asked-questions/index.html | 5 +-
.../index.html | 5 +-
.../index.html | 5 +-
.../index.html | 5 +-
blog/index.html | 5 +-
.../jupyter-notebooks-for-data-analysis/index.html | 5 +-
.../index.html | 5 +-
category/cybersecurity/index.html | 5 +-
category/data-science/index.html | 5 +-
category/ipython-notebooks/index.html | 5 +-
category/security-analytics/index.html | 5 +-
category/threat-analysis-tools/index.html | 5 +-
category/uncategorized/index.html | 5 +-
community/committers/index.html | 5 +-
community/contribute/index.html | 5 +-
community/index.html | 373 ++++++++------
contribute/index.html | 4 +-
doc/index.html | 3 +-
download/index.html | 5 +-
get-started/architecture/index.html | 5 +-
get-started/demo/index.html | 5 +-
get-started/environment/index.html | 5 +-
get-started/index.html | 5 +-
get-started/supporting-apache/index.html | 5 +-
.../index.html | 2 +-
.../index.html | 2 +-
index.html | 6 +-
jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
project-components/ingestion/index.html | 9 +-
project-components/machine-learning/index.html | 9 +-
project-components/open-data-models/index.html | 7 +-
.../suspicious-connects-analysis/index.html | 7 +-
project-components/visualization/index.html | 5 +-
.../index.html | 554 ++++++++++-----------
tag/github/index.html | 5 +-
tag/open-network-insight/index.html | 5 +-
tag/open-source/index.html | 5 +-
49 files changed, 870 insertions(+), 564 deletions(-)
[incubator-spot] 10/45: Adding the correct branding,
adding Apache Spot (incubating) to blog entry Using NetFlows to
Detect Threats to Critical Infrastructure
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 4d87f03ae249bda486195a59f5453b0611af9a00
Author: Cesar <ce...@apache.org>
AuthorDate: Mon Oct 17 23:35:33 2016 -0500
Adding the correct branding, adding Apache Spot (incubating) to blog entry Using NetFlows to Detect Threats to Critical Infrastructure
---
.../index.html | 14 +++++++-------
1 file changed, 7 insertions(+), 7 deletions(-)
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 11fb459..f764e54 100644
--- a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -31,9 +31,9 @@
<link rel='dns-prefetch' href='//fonts.googleapis.com' />
<link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure Comments Feed" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure Comments Feed" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -222,16 +222,16 @@
First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
</p>
<p>
- Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
+ Apache Spot (Incubating) offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot (Incubating) is an ideal solution for this cybersecurity challenge. Apache Spot (Incubating) can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different at [...]
</p>
<p>
- Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
+ Not only can Apache Spot (Incubating) collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot (Incubating) is an open-source project.
</p>
<p>
<strong>But Wait, There’s More</strong>
</p>
<p>
- Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
+ Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot (Incubating) architecture.
</p>
<p>
This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
@@ -293,7 +293,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2016 Apache Spot (Incubating).
</p>
</div>
[incubator-spot] 36/45: Remove Kerberos support on documentation
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 92b0192af48c5d64a6d68606e65887380bd01106
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Thu Sep 7 15:40:24 2017 -0500
Remove Kerberos support on documentation
---
2016/03/index.html | 3 ---
2016/08/index.html | 3 ---
2016/09/index.html | 3 ---
2016/10/index.html | 3 ---
2017/03/index.html | 3 ---
blog/apache-spot-3-most-asked-questions/index.html | 3 ---
.../index.html | 3 ---
.../index.html | 3 ---
.../index.html | 3 ---
blog/index.html | 3 ---
.../jupyter-notebooks-for-data-analysis/index.html | 3 ---
.../index.html | 3 ---
category/cybersecurity/index.html | 3 ---
category/data-science/index.html | 3 ---
category/ipython-notebooks/index.html | 3 ---
category/security-analytics/index.html | 3 ---
category/threat-analysis-tools/index.html | 3 ---
category/uncategorized/index.html | 3 ---
community/committers/index.html | 3 ---
community/contribute/index.html | 3 ---
community/index.html | 3 ---
doc/index.html | 28 ----------------------
download/index.html | 6 ++---
get-started/architecture/index.html | 3 ---
get-started/demo/index.html | 3 ---
get-started/environment/index.html | 3 ---
get-started/index.html | 3 ---
get-started/supporting-apache/index.html | 3 ---
index.html | 3 ---
project-components/ingestion/index.html | 3 ---
project-components/machine-learning/index.html | 3 ---
project-components/open-data-models/index.html | 3 ---
.../suspicious-connects-analysis/index.html | 3 ---
project-components/visualization/index.html | 3 ---
tag/github/index.html | 3 ---
tag/open-network-insight/index.html | 3 ---
tag/open-source/index.html | 3 ---
37 files changed, 3 insertions(+), 136 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 8785af4..3b720a8 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/2016/08/index.html b/2016/08/index.html
index 5973a38..e42da05 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -83,9 +83,6 @@
<li class="menu-item menu-item-type-custom menu-item-object-custom">
<a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/2016/09/index.html b/2016/09/index.html
index 54fdca6..19d590b 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/2016/10/index.html b/2016/10/index.html
index 8d12ad5..61b5a75 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/2017/03/index.html b/2017/03/index.html
index d953f1e..e0a7f48 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index 32246db..8fb4960 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 747e1c0..d5520d2 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index 24e2eff..ef3eef5 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 0b07777..d1727b7 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/index.html b/blog/index.html
index 3ad2400..6014c39 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index 5a0da00..75ce752 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index ae21cd7..dad7fc1 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 959b58b..8bd6e01 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 2dce6fe..380d966 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index f774b92..f86e23b 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index 9b3e098..accecb0 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 1d2a140..0948e6e 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 2cf4697..2a2e7ca 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/community/committers/index.html b/community/committers/index.html
index 7bbe6f5..ae1b6d4 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/community/contribute/index.html b/community/contribute/index.html
index fb1d454..ddb5eda 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/community/index.html b/community/index.html
index a9ead03..b68c205 100755
--- a/community/index.html
+++ b/community/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/doc/index.html b/doc/index.html
index 7efd4ca..4f74cd8 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -65,9 +65,6 @@
<li class="menu-item">
<a href="../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
@@ -323,31 +320,6 @@
<td>Yes</td>
</tr>
<tr>
- <td>KRB_AUTH</td>
- <td style="text-align:left">(default: false) Turn Kerberos authentication features on/off</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KINITPATH</td>
- <td style="text-align:left">Path to the kinit binary file</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KINITOPTS</td>
- <td style="text-align:left">Additional options to the kinit command</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KEYTABPATH</td>
- <td style="text-align:left">Keytab file path</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KRB_USER</td>
- <td style="text-align:left">Kerberos user</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
<td>LUSER</td>
<td style="text-align:left">The local filesystem path for the solution, "/home/solution-user/"</td>
<td>Yes</td>
diff --git a/download/index.html b/download/index.html
index 58bedfb..d6ba29c 100755
--- a/download/index.html
+++ b/download/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="active menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
@@ -149,6 +146,9 @@
</div>
<div class="content-wrap">
+ <p><strong>Apache Spot Source Code Management</strong></p>
+ <p>If you are interested in working with the newest under-development code or contributing to Apache Spot development, you can also check out the master branch from <a href="https://github.com/apache/incubator-spot" target="_blank">GITHUB</a> by typing:</p>
+ <code>git clone https://github.com/apache/incubator-spot.git</code>
<p><strong>Validate Build:</strong></p>
<ul>
<li>Download the tarball.</li>
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index 2a3a93e..7875aeb 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
index 03811e4..5b32fd0 100755
--- a/get-started/demo/index.html
+++ b/get-started/demo/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
index 12c6091..e8d929f 100755
--- a/get-started/environment/index.html
+++ b/get-started/environment/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/get-started/index.html b/get-started/index.html
index a0a49b4..88c0632 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
index e90ae88..deb691f 100755
--- a/get-started/supporting-apache/index.html
+++ b/get-started/supporting-apache/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/index.html b/index.html
index c36a46f..f3ac606 100755
--- a/index.html
+++ b/index.html
@@ -79,9 +79,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 950377c..ff51117 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 9e329b2..7a7fb8e 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -101,9 +101,6 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 6597b70..bd0dd22 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
index e0f9b4d..2bffb75 100755
--- a/project-components/suspicious-connects-analysis/index.html
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index 754b522..75c4d0b 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/tag/github/index.html b/tag/github/index.html
index af9683f..9a4eb8f 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index d30ec81..343352b 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index f4080c1..2bd2ed2 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -80,9 +80,6 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a href="../../download">Download</a>
</li>
- <li class="menu-item menu-item-type-custom menu-item-object-custom">
- <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
- </li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
[incubator-spot] 11/45: Code updates on the former WP template,
and get the correct usage for branding Apache Spot (Incubating)
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 4fb73596622813531dbb81b5768829d725c17a1d
Author: cesar <ce...@apache.org>
AuthorDate: Tue Oct 18 18:08:12 2016 -0500
Code updates on the former WP template, and get the correct usage for branding Apache Spot (Incubating)
---
blog/index.html | 8 ++++----
category/security-analytics/index.html | 8 ++++----
category/uncategorized/index.html | 8 ++++----
tag/github/index.html | 8 ++++----
tag/open-network-insight/index.html | 8 ++++----
tag/open-source/index.html | 8 ++++----
6 files changed, 24 insertions(+), 24 deletions(-)
diff --git a/blog/index.html b/blog/index.html
index 859e75e..2a4d356 100644
--- a/blog/index.html
+++ b/blog/index.html
@@ -144,16 +144,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
<a href="../blog/">Blog</a>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index 9c716d8..c2eac46 100644
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -143,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 96f1ad4..48a6ef6 100644
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -144,16 +144,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
diff --git a/tag/github/index.html b/tag/github/index.html
index 1d36a96..30bddb1 100644
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -143,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 64c6c02..d776bdf 100644
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -143,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 8cb018f..313d344 100644
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -143,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
[incubator-spot] 02/45: Add placeholder index.html.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit fe7bc1c6ed092f70209865710861813dec109c01
Author: Doug Cutting <cu...@apache.org>
AuthorDate: Tue Sep 27 09:10:02 2016 -0700
Add placeholder index.html.
---
index.html | 9 +++++++++
1 file changed, 9 insertions(+)
diff --git a/index.html b/index.html
new file mode 100644
index 0000000..b133f83
--- /dev/null
+++ b/index.html
@@ -0,0 +1,9 @@
+<html>
+ <head>
+ <title>Apache Spot (incubating)</title>
+ </head>
+<body>
+<h1>Apache Spot (incubating)</h1>
+Apache Spot placeholder page.
+</body>
+</html>
[incubator-spot] 19/45: Correcting contact email address,
and naming on one of the architecture diagrams
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 57febc66cd1fd25e11947d3323984e06523bc46a
Author: Cesar <ce...@apache.org>
AuthorDate: Thu Jan 19 15:29:04 2017 -0600
Correcting contact email address, and naming on one of the architecture diagrams
---
doc/.DS_Store | Bin 0 -> 6148 bytes
1 file changed, 0 insertions(+), 0 deletions(-)
diff --git a/doc/.DS_Store b/doc/.DS_Store
new file mode 100644
index 0000000..5e89886
Binary files /dev/null and b/doc/.DS_Store differ
[incubator-spot] 33/45: Removing Download Section from
subdirectories, and replacing with GitHub pointer
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 5b3788aa06b32717a8a020fae3c95441523297be
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Wed Aug 9 00:58:59 2017 -0500
Removing Download Section from subdirectories, and replacing with GitHub pointer
---
community/index.html | 2 +-
get-started/index.html | 2 +-
index.html | 2 +-
3 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/community/index.html b/community/index.html
index f7a0b98..42eccc8 100755
--- a/community/index.html
+++ b/community/index.html
@@ -78,7 +78,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../download">GitHub</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../community">Community</a>
diff --git a/get-started/index.html b/get-started/index.html
index 2633e5d..1e8ad45 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -78,7 +78,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../download">GitHub</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
diff --git a/index.html b/index.html
index 140c4ba..1b6ff9c 100755
--- a/index.html
+++ b/index.html
@@ -77,7 +77,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="download">GitHub</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="community">Community</a>
[incubator-spot] 08/45: Fixing Inconsistent/incorrect use of Apache
trademark on the blog entry: How Apache Spot (Incubating) Helps Create
Well-Stocked Data Lakes and Catch Powerful Insights
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 1ea11648a8bf512671d0f9ce561c25d7eec5b6d9
Author: cesar <ce...@apache.org>
AuthorDate: Mon Oct 17 18:05:19 2016 -0500
Fixing Inconsistent/incorrect use of Apache trademark on the blog entry: How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights
---
.../index.html | 22 +++++++++++-----------
1 file changed, 11 insertions(+), 11 deletions(-)
diff --git a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 4249e9e..2d2b725 100644
--- a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -31,9 +31,9 @@
<link rel='dns-prefetch' href='//fonts.googleapis.com' />
<link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights Comments Feed" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights Comments Feed" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -196,27 +196,27 @@
About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
</p>
<p>
- Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
+ Apache Spot (Incubating) can help to solve most of these issues. Following is a description of the Apache Spot (Incubating), which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
</p>
<a href="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, ../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png 300w, ../wp-content/uploads/2016/09/ONI_Ar [...]
- <h3><strong>Apache Spot Core Components</strong></h3>
+ <h3><strong>Apache Spot (Incubating) Core Components</strong></h3>
<p>
- The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
+ The Apache Spot (Incubating) Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
</p>
<p>
- In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
+ In this diagram, the top left shows Apache Spot (Incubating) Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot (Incubating)’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot (Incubating) clu [...]
</p>
<h3><strong>Operational Analytics</strong></h3>
<p>
- As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
+ As part of operational analytics, Apache Spot (Incubating) executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” wit [...]
</p>
<h3><strong>Visualizing Results</strong></h3>
<p>
- The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
+ The Apache Spot (Incubating) GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
</p>
<h3><strong>Customizable Open Source</strong></h3>
<p>
- Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
+ Because Apache Spot (Incubating) is an open-source project, most of the components depicted here can be modified by the end user.
</p>
</section>
<footer class="article-footer">
@@ -275,7 +275,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2016 Apache Spot (Incubating).
</p>
</div>
[incubator-spot] 24/45: New menu on Project website, for Coomunity,
includes links to mailing lists, Slack, social media,
and Committers directory
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 3d7ac91ff865cd817183695944facd335796556c
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Tue Mar 28 18:47:02 2017 -0600
New menu on Project website, for Coomunity, includes links to mailing lists, Slack, social media, and Committers directory
---
2016/03/index.html | 28 ++-
2016/08/index.html | 28 ++-
2016/09/index.html | 28 ++-
2016/10/index.html | 28 ++-
{2016 => 2017}/03/index.html | 44 +++--
2017/index.html | 0
blog/apache-spot-3-most-asked-questions/index.html | 28 ++-
.../index.html | 28 ++-
.../feed/index.html | 18 ++
.../index.html | 97 ++++++----
.../index.html | 28 ++-
blog/index.html | 54 +++++-
.../jupyter-notebooks-for-data-analysis/index.html | 28 ++-
.../index.html | 28 ++-
category/cybersecurity/index.html | 28 ++-
category/data-science/index.html | 28 ++-
category/ipython-notebooks/index.html | 28 ++-
category/security-analytics/index.html | 28 ++-
category/threat-analysis-tools/index.html | 28 ++-
category/uncategorized/index.html | 54 +++++-
.../ingestion => community/committers}/index.html | 201 +++++++++++++++------
.../ingestion => community/contribute}/index.html | 112 +++++++-----
.../machine-learning => community}/index.html | 113 ++++++------
doc/css/meanmenu.css | 63 +++++++
doc/css/style.css | 66 +++++++
doc/images/github.png | Bin 0 -> 505 bytes
doc/images/jira.png | Bin 0 -> 232 bytes
doc/images/mail.png | Bin 0 -> 2942 bytes
doc/images/slack_mark_16px.png | Bin 0 -> 769 bytes
doc/images/twitter-icon.png | Bin 0 -> 438 bytes
doc/index.html | 28 ++-
index.html | 61 +++++--
library/css/meanmenu.css | 63 +++++++
library/css/style.css | 171 +++++++++++++++---
...che-Spot-Icon_Cybersecurity-Data-Management.png | Bin 0 -> 1781 bytes
.../images/Apache-Spot-Icon_Network-Traffic.png | Bin 0 -> 2118 bytes
.../Apache-Spot-Icon_Reduction-Mean-Time.png | Bin 0 -> 1896 bytes
library/images/Apache-Spot-Icon_Threat-Hunting.png | Bin 0 -> 2233 bytes
.../blog/2017/03/product-architecture-overview.png | Bin 0 -> 492848 bytes
library/images/github.png | Bin 0 -> 505 bytes
library/images/jira.png | Bin 0 -> 232 bytes
library/images/mail.png | Bin 0 -> 2942 bytes
library/images/masthead-bg.jpg | Bin 431055 -> 264536 bytes
.../{masthead-bg.jpg => masthead-bg_old.jpg} | Bin
library/images/slack_mark_16px.png | Bin 0 -> 769 bytes
library/images/twitter-icon.png | Bin 0 -> 438 bytes
library/js/scripts.js | 13 +-
project-components/ingestion/index.html | 25 ++-
project-components/machine-learning/index.html | 25 ++-
project-components/open-data-models/index.html | 25 ++-
project-components/visualization/index.html | 25 ++-
tag/github/index.html | 28 ++-
tag/open-network-insight/index.html | 28 ++-
tag/open-source/index.html | 28 ++-
54 files changed, 1315 insertions(+), 419 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index c8010e3..4c841fb 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -57,11 +57,6 @@
<body class="archive date">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/2016/08/index.html b/2016/08/index.html
index d31c9e9..0e77f80 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -57,11 +57,6 @@
<body class="archive date">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -177,6 +187,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -197,6 +210,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/2016/09/index.html b/2016/09/index.html
index 5f456cc..0586461 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -57,11 +57,6 @@
<body class="archive date">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -148,6 +158,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -168,6 +181,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/2016/10/index.html b/2016/10/index.html
index 81993a0..0caaa24 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -57,11 +57,6 @@
<body class="archive date">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/2016/03/index.html b/2017/03/index.html
similarity index 74%
copy from 2016/03/index.html
copy to 2017/03/index.html
index c8010e3..126cb29 100755
--- a/2016/03/index.html
+++ b/2017/03/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>March 2016 - Apache Spot</title>
+ <title>March 2017 - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -57,11 +57,6 @@
<body class="archive date">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="doc">Documentation</a>
@@ -111,16 +121,16 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Month: March 2016</h1>
+ <h1 class="page-title">Month: March 2017</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article class="cf post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-product-architecture-overview/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot Product Architecture Overview</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
+ <time class="updated entry-time" datetime="2017-03-27" itemprop="datePublished">
+ March 27, 2017
</time>
</span>
</p>
@@ -129,9 +139,7 @@
<section class="entry-content cf">
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
+ <p>Data Sources - Spot can directly collect netflow data, DNS data and/or proxy data. This data can be collected also from a SIEM or from a common logging server. Additional data types can be collected using Open Data Model. Any number of data sources can be analyzed using Spot. Because most of these data sources represent a large volume of data, most organizations start with the data source that represents the area of highest risk.… <a class="excerp [...]
</section>
@@ -149,6 +157,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +180,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/2017/index.html b/2017/index.html
new file mode 100755
index 0000000..e69de29
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index 6801d0c..b8b8a89 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -57,11 +57,6 @@
<body class="single single-post">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -183,6 +193,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -203,6 +216,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index e2001d6..32efdf4 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -57,11 +57,6 @@
<body class="single single-post">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -188,6 +198,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -208,6 +221,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/blog/apache-spot-product-architecture-overview/feed/index.html b/blog/apache-spot-product-architecture-overview/feed/index.html
new file mode 100755
index 0000000..f7eab49
--- /dev/null
+++ b/blog/apache-spot-product-architecture-overview/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot Product Architecture Overview</title>
+ <atom:link href="http://spot.incubator.apache.org/blog/apache-spot-product-architecture-overview/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/blog/apache-spot-product-architecture-overview/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/apache-spot-product-architecture-overview/index.html
similarity index 57%
copy from blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
copy to blog/apache-spot-product-architecture-overview/index.html
index 7f7a612..8de99c2 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights - Apache Spot</title>
+ <title>Apache Spot Product Architecture Overview - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -57,11 +57,6 @@
<body class="single single-post">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -111,48 +121,55 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+ <article class="cf post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
<header class="article-header entry-header">
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot Product Architecture Overview</h1>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
+ <time class="updated entry-time" datetime="2017-03-27" itemprop="datePublished">
+ March 27, 2017
</time>
</span>
</p>
</header>
<section class="entry-content cf" itemprop="articleBody">
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
- </p>
- <p>
- Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
- </p>
- <a href="../../library/images/ONI_Architecture-Diagram_1300_v4.png"><img src="../../library/images/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" /></a>
- <h3><strong>Apache Spot Core Components</strong></h3>
- <p>
- The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
- </p>
- <p>
- In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
- </p>
- <h3><strong>Operational Analytics</strong></h3>
- <p>
- As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
- </p>
- <h3><strong>Visualizing Results</strong></h3>
- <p>
- The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
- </p>
- <h3><strong>Customizable Open Source</strong></h3>
- <p>
- Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
- </p>
+ <img src="../../library/images/blog/2017/03/product-architecture-overview.png" alt="" />
+ <h3>Data Sources</h3>
+ <p>Spot can directly collect netflow data, DNS data and/or proxy data. This data can be collected also from a SIEM or from a common logging server. Additional data types can be collected using Open Data Model. Any number of data sources can be analyzed using Spot. Because most of these data sources represent a large volume of data, most organizations start with the data source that represents the area of highest risk.</p>
+ <h3>Data Storage</h3>
+ <p>Using nfdump for netflow data, TShark for DNS data and a parser for proxy data, the Spot collectors process the information that is sent. This data is ingested into Spot’s HDFS. Once Spot has received 3-4 hours of data, the analysis to detect suspicious connections using machine learning algorithms is performed.</p>
+
+ <h3>Data Analysis and Machine Learning</h3>
+ <p>The machine learning component of Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable and most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS and proxy records.</p>
+
+ <p>Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents.</p>
+
+ <p>Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
+
+ <blockquote>LDA is a generative probabilistic model used for discrete data such as text corpora. LDA is a three- level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common n [...]
+
+ <h3>Analytics</h3>
+ <p>Context is then added to the results generated by machine learning algorithms. The results are enriched, with relocalization and threat reputation for each connection, accelerating the detection of compromise indicators.</p>
+
+ <h3>Visualization</h3>
+ <p>The top 300 suspicious results are sent to the Spot GUI to visualize. With the Spot GUI, the top suspicious network activity can be reviewed and the user can engage with data right in the browser. The Spot GUI can also be used to execute advanced search or create a storyboard of the security threats. It also takes advantage of latest Web technologies to provide Web Components (ReactJS+Flux), amazing user experience (Bootstrap + D3), data manipulation (IPython notebooks) and ea [...]
+
+ <h3>New in March 10, 2017 Release</h3>
+ <ul>
+ <li>Use GraphQL to query data from HDFS Parquet files instead of Local File System CSVs files</li>
+ <li>Modify OA module to save data in HDFS instead of CSVs files</li>
+ <li>Create API to get Spot data from HDFS using Impala</li>
+ <li>Modify ML component to read feedback direct from HDFS</li>
+ <li>Database schema change to store spot data</li>
+ </ul>
+
+ <h3>Coming in Future Releases</h3>
+ <p>In the next releases, Apache Spot will share IoC (suspicious results ranked) with other security tools. Suspicious results scored as a critical can be shared using McAfee Open DXL with the Open Security Controller and/or McAfee ePO to adjust or tune your security policies in real time.</p>
+ <p class="small">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. “Latent Dirichlet Allocation.” Journal of Machine Learning Research 3, no. Jan (2003): 993-1022.</p>
</section>
<footer class="article-footer">
@@ -170,6 +187,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -190,6 +210,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 7f7a612..b281029 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -57,11 +57,6 @@
<body class="single single-post">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -170,6 +180,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -190,6 +203,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/blog/index.html b/blog/index.html
index a5cbdd4..64a218b 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -57,11 +57,6 @@
<body class="blog">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../community/committers">Project Committers</a></li>
+ <li><a href="../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="http://spot.incubator.apache.org/doc">Documentation</a>
@@ -109,6 +119,32 @@
<div id="inner-content" class="wrap cf">
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article class="cf post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../blog/apache-spot-product-architecture-overview/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot Product Architecture Overview</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2017-03-27" itemprop="datePublished">
+ March 27, 2017
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>Data Sources - Spot can directly collect netflow data, DNS data and/or proxy data. This data can be collected also from a SIEM or from a common logging server. Additional data types can be collected using Open Data Model. Any number of data sources can be analyzed using Spot. Because most of these data sources represent a large volume of data, most organizations start with the data source that represents the area of highest risk.… <a class="excerp [...]
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
<article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
@@ -243,6 +279,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -263,6 +302,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index 68d8ffd..69b2ea2 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -57,11 +57,6 @@
<body class="single single-post">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -218,6 +228,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -238,6 +251,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index e15329e..33151e4 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -57,11 +57,6 @@
<body class="single single-post">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -159,6 +169,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -179,6 +192,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index baccf1d..77669d7 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index c2a2518..e9f2290 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 3445cf1..cfb07ca 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -148,6 +158,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -168,6 +181,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index 2ac8872..436d11e 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -148,6 +158,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -168,6 +181,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 7097759..d882df0 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index e529687..bc1fe9c 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -111,6 +121,32 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
<h1 class="page-title">Category: Uncategorized</h1>
+
+ <article class="cf post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-product-architecture-overview/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot Product Architecture Overview</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2017-03-27" itemprop="datePublished">
+ March 27, 2017
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>Data Sources - Spot can directly collect netflow data, DNS data and/or proxy data. This data can be collected also from a SIEM or from a common logging server. Additional data types can be collected using Open Data Model. Any number of data sources can be analyzed using Spot. Because most of these data sources represent a large volume of data, most organizations start with the data source that represents the area of highest risk.… <a class="excerp [...]
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
<article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
@@ -176,6 +212,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -196,6 +235,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/project-components/ingestion/index.html b/community/committers/index.html
similarity index 52%
copy from project-components/ingestion/index.html
copy to community/committers/index.html
index 1c2c877..75f46c5 100755
--- a/project-components/ingestion/index.html
+++ b/community/committers/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Ingestion - Apache Spot</title>
+ <title>Committers - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -57,11 +57,6 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -78,17 +73,32 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li class="active"><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
<li><a href="../../project-components/open-data-models">Open Data Models</a></li>
- <li class="active"><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
</ul>
@@ -104,55 +114,135 @@
</header>
<div id="mobile-nav"></div>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
<div id="content">
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
- <h1 class="page-title">Apache Spot Ingestion</h1>
-
- <p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the dat [...]
-
- <p><img src="../../library/images/ingestion.png" alt="" /></p>
-
- <h3>Inside the Ingest</h3>
-
- <h4><em>Spot-Collectors</em></h4>
-
- <p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
-
- <p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
- <p>Once a file has been uploaded there two paths are available.</p>
-
- <ol>
- <li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
- <li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
- </ol>
-
- <h4><em>Kafka</em></h4>
-
- <p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
-
- <h4><em>Spot Workers</em></h4>
-
- <p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
-
- <p>Currently there are two types of Spot Workers.</p>
-
- <ol>
- <li>Python workers use multithreading to process data with the defined parsers.</li>
- <li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
- </ol>
+ <h1>Apache Spot Committers</h1>
+ <p>Following is a list of current Spot committers.</p>
+
+ <div class="divTable" style="width: 100%;">
+ <div class="divTableBody">
+ <div class="divTableRow tableHeading">
+ <div class="divTableCell">Username</div>
+ <div class="divTableCell">Name</div>
+ <div class="divTableCell">Role</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">jarcec</div>
+ <div class="divTableCell">Jarek Jarcec Cecho</div>
+ <div class="divTableCell">Mentor</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">brock</div>
+ <div class="divTableCell">Brock Noland</div>
+ <div class="divTableCell">Mentor</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">asavu</div>
+ <div class="divTableCell">Andrei Savu</div>
+ <div class="divTableCell">Mentor</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">umamahesh</div>
+ <div class="divTableCell">Uma Maheswara Rao G</div>
+ <div class="divTableCell">Mentor</div>
+ </div>
+
+ <div class="divTableRow">
+ <div class="divTableCell">rabarona</div>
+ <div class="divTableCell">Ricardo Barona</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">cesar</div>
+ <div class="divTableCell">Cesar Berho</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">jarcec</div>
+ <div class="divTableCell">Jarek Jarcec Cecho</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">vganji</div>
+ <div class="divTableCell">Sai Ganji</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">ledagl</div>
+ <div class="divTableCell">Leda Gabriela Lima Garza</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">vgonzale</div>
+ <div class="divTableCell">Victor Gonzalez</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">mark</div>
+ <div class="divTableCell">Mark Grover</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell"></div>
+ <div class="divTableCell">Morris Hicks</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">leahy</div>
+ <div class="divTableCell">Austin Leahy</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">ashrith</div>
+ <div class="divTableCell">Ashrith Mekala</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">daortizh</div>
+ <div class="divTableCell">Diego Ortiz</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">sudarshan.rao.p</div>
+ <div class="divTableCell">Sudharshan Rao PakalaSai</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">vsr</div>
+ <div class="divTableCell">Srinivasa Reddy</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">alan</div>
+ <div class="divTableCell">Alan Ross</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">everlosa</div>
+ <div class="divTableCell">Everardo Lopez Sandoval</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell"></div>
+ <div class="divTableCell">Nathan Segerlind</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">solrac901</div>
+ <div class="divTableCell">Carlos Villavicencio</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell">zrlram</div>
+ <div class="divTableCell">Raffael Marty</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+
+ </div>
+ </div>
</div>
@@ -163,9 +253,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/project-components/ingestion/index.html b/community/contribute/index.html
similarity index 52%
copy from project-components/ingestion/index.html
copy to community/contribute/index.html
index 1c2c877..da80d18 100755
--- a/project-components/ingestion/index.html
+++ b/community/contribute/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Ingestion - Apache Spot</title>
+ <title>Contribute - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -57,11 +57,6 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -78,17 +73,32 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li class="active"><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
<li><a href="../../project-components/open-data-models">Open Data Models</a></li>
- <li class="active"><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
</ul>
@@ -104,58 +114,77 @@
</header>
<div id="mobile-nav"></div>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
<div id="content">
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
- <h1 class="page-title">Apache Spot Ingestion</h1>
-
- <p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the dat [...]
+ <h1 class="page-title">Proposed Apache-Spot (incubating) Commit Workflow</h1>
- <p><img src="../../library/images/ingestion.png" alt="" /></p>
+ <p><strong>NOTE: Most of this guide is based on ASF Documentation.</strong></p>
- <h3>Inside the Ingest</h3>
+ <p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.</p>
- <h4><em>Spot-Collectors</em></h4>
+ <p>Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
- <p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
+ <h3 class="center" style="margin-top:35px;">Individual Push (most commonly used by the community):</h3>
+
+ <p><img src="../../library/images/individual-push.png" alt="" /></p>
- <p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
- <p>Once a file has been uploaded there two paths are available.</p>
+ <p><strong>Steps:</strong></p>
<ol>
- <li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
- <li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
+ <li>For the Github repository at <a href="https://github.com/apache/incubator-spot" target="_blank">https://github.com/apache/incubator-spot</a> if you haven't already. For more information about Fork please go to: <a href="https://help.github.com/articles/fork-a-repo/" target="_blank">https://help.github.com/articles/fork-a-repo/</a></li>
+ <li>Clone your fork, create a new branch named after a Jira issue (i.e. <strong>spot-100</strong>).</li>
+ <li>Push commits to your local branch.</li>
+ <li>Test it!!!</li>
+ <li>Create a pull request (PR) against the upstream repo (master) of apache-spot. For more information about how to create a pull request please go to: <a href="https://help.github.com/articles/about-pull-requests/" target="_blank">https://help.github.com/articles/about-pull-requests/</a>.</li>
+ <li>Wait for the maintainers to review your PR.</li>
</ol>
- <h4><em>Kafka</em></h4>
+ <h3 class="center" style="margin-top:35px;">Topic Branching (upstream)</h3>
- <p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
+ <p>What are a topic branches?</p>
- <h4><em>Spot Workers</em></h4>
+ <blockquote>According to the git definition: "<em>A topic branch is a short-lived branch that you create and use for a single particular feature or related work.</em>" (<a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches</a>)</blockquote>
- <p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
+ <p>Sometimes a new major feature will have dependencies between modules or developers that can't be separated into individual pushes, when this happens, a topic branch will be created to deliver the complete functionality before the merge with the upstream (encapsulated dev enviroment).</p>
- <p>Currently there are two types of Spot Workers.</p>
+ <p>In order to create a topic branch, three requirements are needed:</p>
<ol>
- <li>Python workers use multithreading to process data with the defined parsers.</li>
- <li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
- </ol>
+ <li>A design document must be uploaded using Jira. This design must be approved by the maintainers.</li>
+ <li>A voting process will be required to approve the topic branch creation, at least 3 maintainers need to approve it.</li>
+ <li>A commitment to delete the branch after merging it into the upstream branch must be done. The topic branch should only exist while the work is still in progress.</li>
+ </ol>
+ <p>A meaningful name must be given to the branch. It is recommended to use JIRA issue created with the design document to link the branch.</p>
+
+ <p><img src="../../library/images/topic-branching.png" alt="" /></p>
+
+ <p><strong>IMPORTANT: There shouldn't be a push without a Jira created previously</strong></p>
+
+ <h3>Approvals and Voting Process:</h3>
+
+ <blockquote>
+ <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
+
+ <p>Unless a vote has been declared as using <u>lazy consensus</u>, three +1 votes are required for a code-modification proposal to pass.</p>
+
+ <p>Whole numbers are recommended for this type of vote, as the opinion being expressed is Boolean: 'I approve/do not approve of this change.'</p>
+
+ <p><strong>Source: <a href="http://apache.org/foundation/voting.html" target="_blank">http://apache.org/foundation/voting.html</a></strong></p>
+ </blockquote>
+
+ <h3>Useful links:</h3>
+
+ <ul>
+ <li><a href="https://www.apache.org/foundation/glossary.html" target="_blank">https://www.apache.org/foundation/glossary.html</a></li>
+ <li><a href="http://www.apache.org/dev/committers" target="_blank">http://www.apache.org/dev/committers</a></li>
+ <li><a href="http://www.apache.org/dev/git.html" target="_blank">http://www.apache.org/dev/git.html</a></li>
+ <li><a href="http://www.apache.org/dev/writable-git" target="_blank">http://www.apache.org/dev/writable-git</a></li>
+ </ul>
</div>
-
</div>
</div>
@@ -163,9 +192,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/project-components/machine-learning/index.html b/community/index.html
similarity index 51%
copy from project-components/machine-learning/index.html
copy to community/index.html
index 2224750..b24afca 100755
--- a/project-components/machine-learning/index.html
+++ b/community/index.html
@@ -12,35 +12,35 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Machine Learning - Apache Spot</title>
+ <title>Community - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
<meta name="viewport" content="width=device-width, initial-scale=1"/>
- <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
- <link rel="icon" href="../../favicon.png">
+ <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../favicon.png">
<!--[if IE]>
<link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
<![endif]-->
<meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
<link rel='dns-prefetch' href='//fonts.googleapis.com' />
<link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
<link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
<!--[if lt IE 9]>
<link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
<![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
- <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+ <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
@@ -57,17 +57,12 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
<p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../library/images/logo.png" alt="Apache Spot" /></a>
</p>
<nav>
@@ -78,23 +73,38 @@
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
+ <a href="../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li class="active"><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../community/committers">Project Committers</a></li>
+ <li><a href="../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a href="../../doc">Documentation</a>
+ <a href="../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
- <li><a href="../../project-components/ingestion">Ingestion</a></li>
- <li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
- <li><a href="../../project-components/visualization">Visualization</a></li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
- <a href="../../blog">Blog</a>
+ <a href="../blog">Blog</a>
</li>
</ul>
</nav>
@@ -104,36 +114,34 @@
</header>
<div id="mobile-nav"></div>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
<div id="content">
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
- <h1 class="page-title">Apache Spot Machine Learning</h1>
-
- <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
- <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
- <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
- <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
-
- <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
- </div>
+ <h1>Apache Spot Mailing Lists and Chat Rooms</h1>
+ <p>Get help using Spot or contribute to the project on our mailing lists or our chat room:</p>
+
+ <ul>
+ <li><a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (archives) - for usage questions, help, and announcements.</li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Spot Slack channel</a> - where many Spot developers and users hang out to answer questions and chat.</li>
+ </ul>
+
+ <strong>Developer mailing lists</strong>
+ <ul>
+ <li><a href="mailto:dev@spot.incubator.apache.org">dev@spot.incubator.apache.org</a> (<a href="mailto:dev-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:dev-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-dev/" target="_blank">archives</a>) - for people who want to contribute code to Spot.</li>
+ <li><a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issue tracker.</li>
+ <li><a href="mailto:commits@spot.incubator.apache.org">commits@spot.incubator.apache.org</a> (<a href="mailto:commits-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:commits-subscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/incubator-spot-commits/" target="_blank">archives</a>) - receives an email notification of all code changes to the Spot Git repository.</li>
+ </ul>
+
+ <strong>Other developer resources</strong>
+ <ul>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ </ul>
+ </div>
+
</div>
</div>
@@ -141,15 +149,12 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
</p>
- <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ <p style="margin-top:50px;"><img src="../library/images/apache-incubator.png" alt="Apache Incubator" />
</p>
<p class="disclaimer">
@@ -176,7 +181,7 @@
</div>
<a href="#0" class="cd-top">Top</a>
- <script type='text/javascript' src='../../library/js/scripts.js'></script>
+ <script type='text/javascript' src='../library/js/scripts.js'></script>
</body>
diff --git a/doc/css/meanmenu.css b/doc/css/meanmenu.css
index 3cf6e41..390797e 100755
--- a/doc/css/meanmenu.css
+++ b/doc/css/meanmenu.css
@@ -168,3 +168,66 @@ a.meanmenu-reveal {
.mean-remove {
display: none !important;
}
+
+
+.mean-container .mean-nav ul li ul.sub-menu.com-sm li.dropmenu-head {
+ display: block;
+ float: left;
+ width: 90%;
+ padding: 1em 5%;
+ margin: 0;
+ text-align: left;
+ color: #0b0b0b;
+ border-bottom:1px solid rgba(255,255,255,0.8);
+ border-top: 1px solid rgba(255,255,255,0.8);
+ text-decoration: none;
+ text-transform: uppercase;
+}
+.mean-container .mean-nav .slack {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .github {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .jira {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .mail {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .twitter-icon {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .slack:hover {
+ background:rgba(255,255,255,.1) url('../images/slack_mark_16px.png') no-repeat;
+}
+.mean-container .mean-nav .github:hover {
+ background:rgba(255,255,255,.1) url('../images/github.png') no-repeat;
+}
+.mean-container .mean-nav .jira:hover {
+ background:rgba(255,255,255,.1) url('../images/jira.png') no-repeat;
+}
+.mean-container .mean-nav .mail:hover {
+ background:rgba(255,255,255,.1) url('../images/mail.png') no-repeat;
+}
+.mean-container .mean-nav .twitter-icon:hover {
+ background:rgba(255,255,255,.1) url('../images/twitter-icon.png') no-repeat;
+}
+
+@media only screen and (min-width:768px) {
+ .mean-container .mean-nav .slack {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .github {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .jira {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .mail {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .twitter-icon {
+ background-position:left 7% center !important;
+ }
+}
diff --git a/doc/css/style.css b/doc/css/style.css
index cc9fcdd..ca843b0 100755
--- a/doc/css/style.css
+++ b/doc/css/style.css
@@ -303,6 +303,27 @@ img { max-width: 100%; height: auto; }
.orange-bold {color:#c97644;font-weight:bold;font-style:italic;}
#configuration .orange-bold {margin-bottom:10px;}
.short-mrg {margin-bottom:10px;}
+
+.slack {
+ background:url('../images/slack_mark_16px.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.github {
+ background:url('../images/github.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.mail {
+ background:url('../images/mail.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.jira {
+ background:url('../images/jira.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.twitter-icon {
+ background:url('../images/twitter-icon.png') no-repeat 0 center;
+ padding-left:21px;
+}
/*********************
LAYOUT
*********************/
@@ -535,6 +556,51 @@ table.configuration.config2 tr td:nth-child(2) {font-size:9.5pt !important;}
.cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
.nav li a { padding: .75em 1.6em; }
.nav li:last-child a {padding-right:0;}
+.nav li ul.sub-menu.com-sm li a {
+ border-bottom:none;
+}
+ .dropmenu-head {
+ float: none;
+ border-right: 0;
+ display: block;
+ width: 235px;
+ text-transform:uppercase;
+ color:#666;
+ padding:0 10px 0 15px;
+ border-bottom:none;
+ font-size:.95em;
+}
+.sub-menu.com-sm .dropmenu-head:first-child {
+ padding-top:10px;
+}
+.sub-menu.com-sm .mail,
+.sub-menu.com-sm .slack,
+.sub-menu.com-sm .github,
+.sub-menu.com-sm .twitter-icon,
+.sub-menu.com-sm .jira {
+ background-position:left 15px center;
+}
+.nav li ul.sub-menu.com-sm li .mail,
+.nav li ul.sub-menu.com-sm li .slack,
+.nav li ul.sub-menu.com-sm li .github,
+.nav li ul.sub-menu.com-sm li .twitter-icon,
+.nav li ul.sub-menu.com-sm li .jira {
+ padding-left:40px;
+}
+.sub-menu.com-sm li a {
+ padding:5px 10px 5px 25px;
+}
+li.divider {
+ border-bottom:1px solid #ccc;
+ width:100%;
+ margin:10px 0 !important;
+}
+.nav li ul.sub-menu.com-sm li {
+ margin-bottom:0;
+}
+.nav li ul.sub-menu.com-sm li a {
+ padding-left:15px;
+}
#masthead .wrap {min-height:360px;display: flex; justify-content: flex-end; align-items: center; align-content: flex-end;text-align:right;}
.cbp-spmenu {position:fixed;}
diff --git a/doc/images/github.png b/doc/images/github.png
new file mode 100755
index 0000000..2d4c151
Binary files /dev/null and b/doc/images/github.png differ
diff --git a/doc/images/jira.png b/doc/images/jira.png
new file mode 100755
index 0000000..89a1b7b
Binary files /dev/null and b/doc/images/jira.png differ
diff --git a/doc/images/mail.png b/doc/images/mail.png
new file mode 100755
index 0000000..3c3f9a5
Binary files /dev/null and b/doc/images/mail.png differ
diff --git a/doc/images/slack_mark_16px.png b/doc/images/slack_mark_16px.png
new file mode 100755
index 0000000..13afbc5
Binary files /dev/null and b/doc/images/slack_mark_16px.png differ
diff --git a/doc/images/twitter-icon.png b/doc/images/twitter-icon.png
new file mode 100755
index 0000000..bed6f43
Binary files /dev/null and b/doc/images/twitter-icon.png differ
diff --git a/doc/index.html b/doc/index.html
index 2bfaeef..5c09b0d 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -58,9 +58,24 @@
<li class="menu-item">
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
- <li class="menu-item">
- <a href="../contribute">Contribute</a>
- </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../community/committers">Project Committers</a></li>
+ <li><a href="../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
<li class="menu-item active">
<a href="../doc/">Documentation</a>
</li>
@@ -630,8 +645,8 @@
</p>
<p class="short-mrg">Where:</p>
<ul>
- <li>: Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the following keys, where you'll need to add the corresponding node name.<br></li>
- <li>: The node name in your cluster where you have the database service running.</li>
+ <li>"oa_data_engine": Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the following keys, where you'll need to add the corresponding node name.<br></li>
+ <li>"impala_daemon": The node name in your cluster where you have the database service running.</li>
</ul>
</li>
</ol>
@@ -1314,9 +1329,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/index.html b/index.html
index 47b5a32..8623bc6 100755
--- a/index.html
+++ b/index.html
@@ -40,7 +40,7 @@
<script type='text/javascript' src='library/js/libs/modernizr.custom.min.js'></script>
<script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
<script type='text/javascript' src='library/js/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='/library/js/jquery.meanmenu.js'></script>
+ <script type='text/javascript' src='library/js/jquery.meanmenu.js'></script>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
@@ -57,11 +57,6 @@
<body class="home">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -78,7 +73,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="contribute">Contribute</a>
+ <a href="community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="community/committers">Project Committers</a></li>
+ <li><a href="community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="doc">Documentation</a>
@@ -112,7 +122,7 @@
</div>
<div class="m-all t-1of2 d-1of2 contribute">
<h3>Help Spot expand his hunting ground to see deeper into the darkness of cyber threats.</h3>
- <p class="btn-margin"><a href="contribute" class="y-btn">Become a Contributor</a></p>
+ <p class="btn-margin"><a href="community/contribute" class="y-btn">Become a Contributor</a></p>
</div>
</div>
</div>
@@ -322,12 +332,12 @@
<div class="table">
<div class="table-row">
<div class="table-cell quote-man">
- <img src="library/images/quote-person.png" alt="" />
- <h3>Senior Analyst</h3>
+ <img src="library/images/Apache-Spot-Icon_Network-Traffic.png" alt="" />
</div>
<div class="table-cell">
+ <h3>Network Traffic Analytics</h3>
<p>
- ...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”
+ Spot allows organizations to detect potentially malicious activity by identifying suspicious network connections, by analyzing large amounts of netflow, DNS, proxy data with algorithms that are available out of the box.
</p>
</div>
</div>
@@ -336,12 +346,12 @@
<div class="table">
<div class="table-row">
<div class="table-cell quote-man">
- <img src="library/images/quote-person.png" alt="" />
- <h3>Junior Analyst</h3>
+ <img src="library/images/Apache-Spot-Icon_Reduction-Mean-Time.png" alt="" />
</div>
<div class="table-cell">
+ <h3>Reduction of mean time to incident detection &resolution (MTTR)</h3>
<p>
- ...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
+ Spot provides the capability for a central data store that houses ALL the data needed to facilitate an investigation, returning investigative query results in seconds and minutes (vs. hours and days), which effectively reduces incident MTTR and minimizes the adverse impacts of a breach.
</p>
</div>
</div>
@@ -350,16 +360,30 @@
<div class="table">
<div class="table-row">
<div class="table-cell quote-man">
- <img src="library/images/quote-person.png" alt="" />
- <h3>Decision Maker</h3>
+ <img src="library/images/Apache-Spot-Icon_Threat-Hunting.png" alt="" />
</div>
<div class="table-cell">
+ <h3>Threat Hunting</h3>
<p>
- ...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
+ Spot improves the efficacy of threat hunting by providing the analytic flexibility to perform ad-hoc searches and queries over vast amounts of data, as well as applying ad-hoc algorithms to detect the needle in the haystack.
</p>
</div>
</div>
</div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/Apache-Spot-Icon_Cybersecurity-Data-Management.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Cybersecurity Data Management</h3>
+ <p>
+ Offloading data from legacy cybersecurity systems (e.g., SIEMs) to Spot delivers immediate economic value, because of the cost of data storage and processing with Hadoop. It also opens up future value as organizations deploy one of the many analytics use cases on their newly formed security data hub.
+ </p>
+ </div>
+ </div>
+ </div>
</div>
@@ -376,9 +400,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/library/css/meanmenu.css b/library/css/meanmenu.css
index 3cf6e41..025901b 100755
--- a/library/css/meanmenu.css
+++ b/library/css/meanmenu.css
@@ -168,3 +168,66 @@ a.meanmenu-reveal {
.mean-remove {
display: none !important;
}
+
+.mean-container .mean-nav ul li ul.sub-menu.com-sm li.dropmenu-head {
+ display: block;
+ float: left;
+ width: 90%;
+ padding: 1em 5%;
+ margin: 0;
+ text-align: left;
+ color: #0b0b0b;
+ border-bottom:1px solid rgba(255,255,255,0.8);
+ border-top: 1px solid rgba(255,255,255,0.8);
+ text-decoration: none;
+ text-transform: uppercase;
+}
+
+.mean-container .mean-nav .slack {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .github {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .jira {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .mail {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .twitter-icon {
+ background-position:left 15px center !important;
+}
+.mean-container .mean-nav .slack:hover {
+ background:rgba(255,255,255,.1) url('../images/slack_mark_16px.png') no-repeat;
+}
+.mean-container .mean-nav .github:hover {
+ background:rgba(255,255,255,.1) url('../images/github.png') no-repeat;
+}
+.mean-container .mean-nav .jira:hover {
+ background:rgba(255,255,255,.1) url('../images/jira.png') no-repeat;
+}
+.mean-container .mean-nav .mail:hover {
+ background:rgba(255,255,255,.1) url('../images/mail.png') no-repeat;
+}
+.mean-container .mean-nav .twitter-icon:hover {
+ background:rgba(255,255,255,.1) url('../images/twitter-icon.png') no-repeat;
+}
+
+@media only screen and (min-width:768px) {
+ .mean-container .mean-nav .slack {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .github {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .jira {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .mail {
+ background-position:left 7% center !important;
+ }
+ .mean-container .mean-nav .twitter-icon {
+ background-position:left 7% center !important;
+ }
+}
\ No newline at end of file
diff --git a/library/css/style.css b/library/css/style.css
index 7381745..fcc568a 100755
--- a/library/css/style.css
+++ b/library/css/style.css
@@ -40,6 +40,28 @@
content: "\e900";
}
+
+.slack {
+ background:url('../images/slack_mark_16px.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.github {
+ background:url('../images/github.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.mail {
+ background:url('../images/mail.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.jira {
+ background:url('../images/jira.png') no-repeat 0 center;
+ padding-left:21px;
+}
+.twitter-icon {
+ background:url('../images/twitter-icon.png') no-repeat 0 center;
+ padding-left:21px;
+}
+
/* Made with Bones: http://themble.com/bones :) */
/******************************************************************
Site Name:
@@ -618,7 +640,7 @@ style a page via class
/*********************
LAYOUT & GRID STYLES
*********************/
-.wrap { width: 85%; margin: 0 auto; }
+.wrap { /*width: 85%;*/width:95%; margin: 0 auto; }
.center { text-align: center; }
@@ -802,7 +824,7 @@ POSTS & CONTENT STYLES
#use-case { padding: 50px 0; background: #fff; }
#use-case h1 { text-align: center; margin-bottom: 0; }
-#use-case h3 { color: #860309; text-align: center; font-weight: 500; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; letter-spacing: 1px; margin: 10px 0 35px; font-size: 13pt;line-height:1.3em; text-transform:uppercase;}
+#use-case h3 { color: #c97644; text-align: center; font-weight: 600; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; letter-spacing: 1px; margin:15px 0; font-size: 13pt;line-height:1.3em; text-transform:uppercase;}
#use-case .number { min-height: 100px; width: 95px; vertical-align: top; }
#use-case .left img { margin-bottom: 50px; }
#use-case .table { padding: 25px 0 25px 0; }
@@ -838,6 +860,46 @@ POSTS & CONTENT STYLES
.page #content h4 {color:#8e8506;font-weight:400;}
.page .wrap.with-sidebar {width:100%;}
+
+.divTable{
+ display: table;
+ width: 100%;
+}
+.divTableRow {
+ display: table-row;
+}
+.divTableCell {
+ border-top: 1px solid #999999;
+ border-right:1px solid #999;
+ display: table-cell;
+ padding: 3px 1%;
+ font-size:12px;
+}
+.divTableRow .divTableCell:nth-of-type(1) {
+ width:18%;
+}
+.divTableRow .divTableCell:nth-of-type(2) {
+ width:31.5%;
+}
+.divTableRow .divTableCell:last-of-type {
+ width:15%;
+}
+.divTableBody {
+ display: table-row-group;
+}
+.tableHeading .divTableCell {
+ font-weight:bold;
+}
+.divTableRow .divTableCell:first-of-type {
+ border-left:1px solid #999;
+}
+.divTableRow:last-of-type .divTableCell {
+ border-bottom:1px solid #999;
+}
+.divTableRow:nth-of-type(even) {
+ background-color:rgba(232,229,224,.6);
+}
+
.hentry { padding: .75em; margin-bottom: 1.5em; }
.hentry footer { padding: 1.5em 0; border-top: 1px solid #d6d6d6; }
.hentry footer p { margin: 0; }
@@ -1070,27 +1132,11 @@ you can add resource intensive styles.
#masthead p { text-align: left; }
.page #masthead .wrap {min-height:250px;}
.page #masthead h1 {text-align:center;margin:0 auto;}
+
- /********************* NAVIGATION STYLES ********************/
- .nav { border: 0; float: right; margin-top: 35px; /* end .menu ul li */ /* highlight current page */ /* end current highlighters */ }
- .nav ul { background: #e8e5e0; margin-top: 0; }
- .nav li { float: left; position: relative; /*
-plan your menus and drop-downs wisely.
-*/ /* showing sub-menus */ }
- .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.5em; /*
-you can use hover styles here even though this size
-has the possibility of being a mobile device.
-*/ }
- .nav li a:hover, .nav li a:focus { color: #c97644; }
- .nav li.active > a {color:#c97644;}
- .nav li ul.sub-menu, .nav li ul.children { margin-top: 0; position: absolute; visibility: hidden;opacity:0; z-index: 8999;padding-left:0; -webkit-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-moz-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-ms-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s; -o-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-i [...]
-
- .nav li ul.sub-menu li a, .nav li ul.children li a { float:none;padding-left: 10px; border-right: 0; display: block; width: 235px; border-bottom: 1px solid #ccc; }
- .nav li ul.sub-menu li a:hover, .nav li ul.children li a:hover {color:#c97644;}
- .nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
- .nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
- .nav li:hover > ul { top: auto; visibility: visible; opacity:1;-moz-transform: translateY(0%);-webkit-transform: translateY(0%); -o-transform: translateY(0%);-ms-transform: translateY(0%); transform: translateY(0%); -webkit-transition-delay: 0s, 0s, 0.3s;-moz-transition-delay: 0s, 0s, 0.3s;-o-transition-delay: 0s, 0s, 0.3s;transition-delay: 0s, 0s, 0.3s; /* this removes the transition delay so the menu will be visible while the other styles transition */}
/* end .nav */
+
+
/********************* CONTENT ********************/
#how-it-works { padding: 100px 0; text-align: left; }
#how-it-works img { display: block; margin: 0 auto; }
@@ -1100,14 +1146,27 @@ has the possibility of being a mobile device.
#use-case .table:first-of-type { padding-top: 0; }
#use-case .table:last-of-type { padding-bottom: 0; }
#use-case .left img { margin-bottom: 0; padding-right: 25px; }
- #use-case h3 {margin: 10px 0 75px;}
- .quotes .table-cell {display:table-cell;text-align:center;}
.table-cell.quote-man {padding-right:35px;text-align:center;}
+ #use-case h3 {margin: 0 0 15px;text-align:left;}
+ .quotes .table-cell {display:table-cell;text-align:left;}
.table-cell.quote-man {padding-right:35px;text-align:center;}
.table-cell.quote-man img {text-align:center;}
.arrow { height: 80px; }
.arrow p { margin: 20px 85px 20px 25px; }
- .arrow:after { border: 40px solid transparent; border-left: 40px solid #f9bf12; }
+ .arrow:after { border: 40px solid transparent; border-left: 40px solid #c97644; }
.hentry { margin-right: 50px; }
+
+ .divTableCell {
+ font-size:11pt;
+ }
+ .divTableRow .divTableCell:nth-of-type(1) {
+ width:18%;
+ }
+ .divTableRow .divTableCell:nth-of-type(2) {
+ width:31.5%;
+ }
+ .divTableRow .divTableCell:last-of-type {
+ width:15%;
+ }
/********************* SIDEBARS & ASIDES ********************/
.sidebar { margin-top: 0; }
.widgettitle { border-bottom: 2px solid #444; margin-bottom: 0.75em; }
@@ -1137,6 +1196,70 @@ you can add resource intensive styles.
.cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
.nav li a { padding: .75em 1.6em; }
.nav li:last-child a {padding-right:0;}
+ /********************* NAVIGATION STYLES ********************/
+ .nav { border: 0; float: right; margin-top: 35px; /* end .menu ul li */ /* highlight current page */ /* end current highlighters */ }
+ .nav ul { background: #e8e5e0; margin-top: 0; }
+ .nav li { float: left; position: relative; /*
+plan your menus and drop-downs wisely.
+*/ /* showing sub-menus */ }
+ .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.5em; /*
+you can use hover styles here even though this size
+has the possibility of being a mobile device.
+*/ }
+ .nav li a:hover, .nav li a:focus { color: #c97644; }
+ .nav li.active > a {color:#c97644;}
+ .nav li ul.sub-menu, .nav li ul.children { width:235px;margin-top: 0; position: absolute; visibility: hidden;opacity:0; z-index: 8999;padding-left:0; -webkit-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-moz-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-ms-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s; -o-transition: all 0.3s ease-in-out 0s, visibility 0s line [...]
+
+ .nav li ul.sub-menu li a, .nav li ul.children li a { float:none;padding-left: 10px; border-right: 0; display: block; width: 235px; border-bottom: 1px solid #ccc; }
+ .nav li ul.sub-menu li a:hover, .nav li ul.children li a:hover {color:#c97644;}
+ .nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
+ .nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
+ .nav li:hover > ul { top: auto; visibility: visible; opacity:1;-moz-transform: translateY(0%);-webkit-transform: translateY(0%); -o-transform: translateY(0%);-ms-transform: translateY(0%); transform: translateY(0%); -webkit-transition-delay: 0s, 0s, 0.3s;-moz-transition-delay: 0s, 0s, 0.3s;-o-transition-delay: 0s, 0s, 0.3s;transition-delay: 0s, 0s, 0.3s; /* this removes the transition delay so the menu will be visible while the other styles transition */}
+.nav li ul.sub-menu.com-sm li a {
+ border-bottom:none;
+}
+ .dropmenu-head {
+ float: none;
+ border-right: 0;
+ display: block;
+ width: 235px;
+ text-transform:uppercase;
+ color:#666;
+ padding:0 10px 0 15px;
+ border-bottom:none;
+ font-size:.95em;
+}
+.sub-menu.com-sm .dropmenu-head:first-child {
+ padding-top:10px;
+}
+.sub-menu.com-sm .mail,
+.sub-menu.com-sm .slack,
+.sub-menu.com-sm .github,
+.sub-menu.com-sm .twitter-icon,
+.sub-menu.com-sm .jira {
+ background-position:left 15px center;
+}
+.nav li ul.sub-menu.com-sm li .mail,
+.nav li ul.sub-menu.com-sm li .slack,
+.nav li ul.sub-menu.com-sm li .github,
+.nav li ul.sub-menu.com-sm li .twitter-icon,
+.nav li ul.sub-menu.com-sm li .jira {
+ padding-left:40px;
+}
+.sub-menu.com-sm li a {
+ padding:5px 10px 5px 25px;
+}
+li.divider {
+ border-bottom:1px solid #ccc;
+ width:100%;
+ margin:10px 0 !important;
+}
+.nav li ul.sub-menu.com-sm li {
+ margin-bottom:0;
+}
+.nav li ul.sub-menu.com-sm li a {
+ padding-left:15px;
+}
img.oniguy { margin-top: 75px; }
.page #masthead .wrap {min-height:360px;display: flex; justify-content: flex-end; align-items: center; align-content: flex-end;text-align:right;}
#and { display: table; border-collapse: separate; width: 100%; }
diff --git a/library/images/Apache-Spot-Icon_Cybersecurity-Data-Management.png b/library/images/Apache-Spot-Icon_Cybersecurity-Data-Management.png
new file mode 100755
index 0000000..819f27d
Binary files /dev/null and b/library/images/Apache-Spot-Icon_Cybersecurity-Data-Management.png differ
diff --git a/library/images/Apache-Spot-Icon_Network-Traffic.png b/library/images/Apache-Spot-Icon_Network-Traffic.png
new file mode 100755
index 0000000..5bb76e1
Binary files /dev/null and b/library/images/Apache-Spot-Icon_Network-Traffic.png differ
diff --git a/library/images/Apache-Spot-Icon_Reduction-Mean-Time.png b/library/images/Apache-Spot-Icon_Reduction-Mean-Time.png
new file mode 100755
index 0000000..af00192
Binary files /dev/null and b/library/images/Apache-Spot-Icon_Reduction-Mean-Time.png differ
diff --git a/library/images/Apache-Spot-Icon_Threat-Hunting.png b/library/images/Apache-Spot-Icon_Threat-Hunting.png
new file mode 100755
index 0000000..ff665ff
Binary files /dev/null and b/library/images/Apache-Spot-Icon_Threat-Hunting.png differ
diff --git a/library/images/blog/2017/03/product-architecture-overview.png b/library/images/blog/2017/03/product-architecture-overview.png
new file mode 100755
index 0000000..bd3f8cf
Binary files /dev/null and b/library/images/blog/2017/03/product-architecture-overview.png differ
diff --git a/library/images/github.png b/library/images/github.png
new file mode 100755
index 0000000..2d4c151
Binary files /dev/null and b/library/images/github.png differ
diff --git a/library/images/jira.png b/library/images/jira.png
new file mode 100755
index 0000000..89a1b7b
Binary files /dev/null and b/library/images/jira.png differ
diff --git a/library/images/mail.png b/library/images/mail.png
new file mode 100755
index 0000000..3c3f9a5
Binary files /dev/null and b/library/images/mail.png differ
diff --git a/library/images/masthead-bg.jpg b/library/images/masthead-bg.jpg
index c5179e2..c12ddd5 100755
Binary files a/library/images/masthead-bg.jpg and b/library/images/masthead-bg.jpg differ
diff --git a/library/images/masthead-bg.jpg b/library/images/masthead-bg_old.jpg
similarity index 100%
copy from library/images/masthead-bg.jpg
copy to library/images/masthead-bg_old.jpg
diff --git a/library/images/slack_mark_16px.png b/library/images/slack_mark_16px.png
new file mode 100755
index 0000000..13afbc5
Binary files /dev/null and b/library/images/slack_mark_16px.png differ
diff --git a/library/images/twitter-icon.png b/library/images/twitter-icon.png
new file mode 100755
index 0000000..bed6f43
Binary files /dev/null and b/library/images/twitter-icon.png differ
diff --git a/library/js/scripts.js b/library/js/scripts.js
index 520d373..c6f2621 100755
--- a/library/js/scripts.js
+++ b/library/js/scripts.js
@@ -93,16 +93,7 @@ var timeToWaitForLast = 100;
* images on mobile to save bandwidth. Once we hit an acceptable viewport
* then we can swap out those images since they are located in a data attribute.
*/
-function loadGravatars() {
- // set the viewport using the function above
- viewport = updateViewportDimensions();
- // if the viewport is tablet or larger, we load in the gravatars
- if (viewport.width >= 768) {
- jQuery('.comment img[data-gravatar]').each(function(){
- jQuery(this).attr('src',jQuery(this).attr('data-gravatar'));
- });
- }
-} // end function
+
/*
@@ -138,4 +129,4 @@ jQuery(document).ready(function($) {
});
-}); /* end of as page load scripts */
+}); /* end of as page load scripts */
\ No newline at end of file
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 1c2c877..2abe9c9 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -57,11 +57,6 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -163,9 +173,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 2224750..3156c0d 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -57,11 +57,6 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -141,9 +151,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 753b5bb..338e9d9 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -57,11 +57,6 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -146,9 +156,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index b65ce18..9e89f3c 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -57,11 +57,6 @@
<body class="page">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -162,9 +172,6 @@
<div id="more-info">
<div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
<p>
<a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
diff --git a/tag/github/index.html b/tag/github/index.html
index 511beef..29aed27 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 2e6a146..5779bc3 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index c7738d7..d853d82 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -57,11 +57,6 @@
<body class="archive tag">
<div id="container">
- <div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
- <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
- </div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -79,7 +74,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="http://spot.incubator.apache.org/contribute">Contribute</a>
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
@@ -149,6 +159,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
+ </li>
+ <li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
<li>
@@ -169,6 +182,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2017/03/'>March 2017</a>
+ </li>
+ <li>
<a href='../../2016/10/'>October 2016</a>
</li>
<li>
[incubator-spot] 42/45: Updated copyright to 2018
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit bdfc505d58e5404f8b28b46603ba51aa73c9e85f
Author: Mark Schoeni <ma...@gmail.com>
AuthorDate: Mon Dec 17 14:42:04 2018 -0600
Updated copyright to 2018
---
2016/03/index.html | 2 +-
2016/08/index.html | 2 +-
2016/09/index.html | 2 +-
2016/10/index.html | 2 +-
2017/03/index.html | 2 +-
apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
blog/index.html | 2 +-
.../jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
category/cybersecurity/index.html | 2 +-
category/data-science/index.html | 2 +-
category/ipython-notebooks/index.html | 2 +-
category/security-analytics/index.html | 2 +-
category/threat-analysis-tools/index.html | 2 +-
category/uncategorized/index.html | 2 +-
community/committers/index.html | 2 +-
community/contribute/index.html | 2 +-
community/index.html | 2 +-
contribute/index.html | 2 +-
download/index.html | 2 +-
get-started/architecture/index.html | 2 +-
get-started/demo/index.html | 2 +-
get-started/environment/index.html | 2 +-
get-started/index.html | 2 +-
get-started/supporting-apache/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
index.html | 2 +-
jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
project-components/ingestion/index.html | 2 +-
project-components/machine-learning/index.html | 2 +-
project-components/open-data-models/index.html | 2 +-
.../suspicious-connects-analysis/index.html | 2 +-
project-components/visualization/index.html | 2 +-
.../index.html | 554 ++++++++++-----------
tag/github/index.html | 2 +-
tag/open-network-insight/index.html | 2 +-
tag/open-source/index.html | 2 +-
45 files changed, 321 insertions(+), 321 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 1483d59..1120fd2 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/2016/08/index.html b/2016/08/index.html
index 1148290..6e5288a 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -250,7 +250,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/2016/09/index.html b/2016/09/index.html
index 19a37e9..937f320 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -216,7 +216,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/2016/10/index.html b/2016/10/index.html
index af21429..532c697 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/2017/03/index.html b/2017/03/index.html
index f6e5297..aee5f7e 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -217,7 +217,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/apache-spot-3-most-asked-questions/index.html b/apache-spot-3-most-asked-questions/index.html
index 437019a..e804b82 100755
--- a/apache-spot-3-most-asked-questions/index.html
+++ b/apache-spot-3-most-asked-questions/index.html
@@ -294,7 +294,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 106ec57..aaef9fa 100755
--- a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -299,7 +299,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index cbd2850..736f7fc 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -253,7 +253,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 788e892..8b50dc9 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -258,7 +258,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index bc731bb..7d03752 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -247,7 +247,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 13fdf6a..35dda0b 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -240,7 +240,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/index.html b/blog/index.html
index 39f30ec..9825ace 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -338,7 +338,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index 43de3c7..eceffec 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -288,7 +288,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 7a339da..64e75fe 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -229,7 +229,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 31de05a..c7585ae 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 0fe19db..61725d9 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 51e3b78..44a361d 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index a2e1955..a15eade 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 9873685..05885c9 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -218,7 +218,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 2162e0e..95308b2 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -271,7 +271,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/community/committers/index.html b/community/committers/index.html
index 372b636..023a4f2 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -348,7 +348,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index d783655..6199429 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -275,7 +275,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/community/index.html b/community/index.html
index 10964e3..81f8efd 100755
--- a/community/index.html
+++ b/community/index.html
@@ -230,7 +230,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/contribute/index.html b/contribute/index.html
index 6bd19d9..537c8c9 100755
--- a/contribute/index.html
+++ b/contribute/index.html
@@ -206,7 +206,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/download/index.html b/download/index.html
index 97d0abb..710291b 100755
--- a/download/index.html
+++ b/download/index.html
@@ -215,7 +215,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index cfaa07d..758f599 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -164,7 +164,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
index 69376cf..8f56b58 100755
--- a/get-started/demo/index.html
+++ b/get-started/demo/index.html
@@ -167,7 +167,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
index 024a546..1789c4f 100755
--- a/get-started/environment/index.html
+++ b/get-started/environment/index.html
@@ -172,7 +172,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/get-started/index.html b/get-started/index.html
index f679152..f554ac6 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -210,7 +210,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
index fb00dae..dde5c6c 100755
--- a/get-started/supporting-apache/index.html
+++ b/get-started/supporting-apache/index.html
@@ -205,7 +205,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index f42e280..dc3589f 100644
--- a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -275,7 +275,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot (Incubating).
+ © 2018 Apache Spot (Incubating).
</p>
</div>
diff --git a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 1879cbe..f31bdd1 100644
--- a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -287,7 +287,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot (Incubating).
+ © 2018 Apache Spot (Incubating).
</p>
</div>
diff --git a/index.html b/index.html
index bc34bfe..be7aa7c 100755
--- a/index.html
+++ b/index.html
@@ -431,7 +431,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/jupyter-notebooks-for-data-analysis/index.html b/jupyter-notebooks-for-data-analysis/index.html
index a3dbec6..47afad9 100644
--- a/jupyter-notebooks-for-data-analysis/index.html
+++ b/jupyter-notebooks-for-data-analysis/index.html
@@ -314,7 +314,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot (Incubating).
+ © 2018 Apache Spot (Incubating).
</p>
</div>
diff --git a/open-network-insight-3-most-asked-questions/index.html b/open-network-insight-3-most-asked-questions/index.html
index 6dec097..1bb6e49 100644
--- a/open-network-insight-3-most-asked-questions/index.html
+++ b/open-network-insight-3-most-asked-questions/index.html
@@ -300,7 +300,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 7424fd1..c6f1b7a 100644
--- a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -305,7 +305,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 83c6354..c00fcc3 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -204,7 +204,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 27020fb..e41e965 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -180,7 +180,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 1ce4d6c..0840478 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -187,7 +187,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
index a63af1c..d9490bf 100755
--- a/project-components/suspicious-connects-analysis/index.html
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -447,7 +447,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index 5417456..251d178 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -203,7 +203,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 90e2cfa..272639a 100755
--- a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -1,278 +1,278 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
-
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Strength in Numbers: Why Consider Open Source Cybersecurity Analytics Comments Feed" href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
- "ext" : ".png",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f = b.createElement("canvas"),
- g = f.getContext && f.getContext("2d"),
- h = String.fromCharCode;
- if (!g || !g.fillText)
- return !1;
- switch(g.textBaseline="top",g.font="600 32px Arial",a) {
- case"flag":
- return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
- case"diversity":
- return g.fillText(h(55356, 57221), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
- case"simple":
- return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../wp-json/' />
- <link rel="canonical" href="http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" />
- <link rel='shortlink' href='http://spot.incubator.apache.org/?p=149' />
- <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fstrength-in-numbers-why-consider-open-source-cybersecurity-analytics%2F" />
- <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fstrength-in-numbers-why-consider-open-source-cybersecurity-analytics%2F&format=xml" />
-
- </head>
-
- <body class="single single-post postid-149 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
+
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Strength in Numbers: Why Consider Open Source Cybersecurity Analytics Comments Feed" href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
+ "ext" : ".png",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f = b.createElement("canvas"),
+ g = f.getContext && f.getContext("2d"),
+ h = String.fromCharCode;
+ if (!g || !g.fillText)
+ return !1;
+ switch(g.textBaseline="top",g.font="600 32px Arial",a) {
+ case"flag":
+ return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
+ case"diversity":
+ return g.fillText(h(55356, 57221), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
+ case"simple":
+ return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" />
+ <link rel='shortlink' href='http://spot.incubator.apache.org/?p=149' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fstrength-in-numbers-why-consider-open-source-cybersecurity-analytics%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fstrength-in-numbers-why-consider-open-source-cybersecurity-analytics%2F&format=xml" />
+
+ </head>
+
+ <body class="single single-post postid-149 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
<a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
- </li>
- <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
- </li>
- <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../blog">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
-
- <header class="article-header entry-header">
-
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</h1>
-
- <p class="byline entry-meta vcard">
-
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
- <section class="entry-content cf" itemprop="articleBody">
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics
- </p>
- <p>
- Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on com [...]
- </p>
- <p>
- This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often look [...]
- </p>
- <p>
- By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve t [...]
- </p>
- <p>
- By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leve [...]
- </p>
- </section>
- <footer class="article-footer">
-
- filed under: <a href="../category/uncategorized/" rel="category tag">Uncategorized</a>
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="h../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
- <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
+ </li>
+ <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics
+ </p>
+ <p>
+ Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on com [...]
+ </p>
+ <p>
+ This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often look [...]
+ </p>
+ <p>
+ By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve t [...]
+ </p>
+ <p>
+ By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leve [...]
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../category/uncategorized/" rel="category tag">Uncategorized</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="h../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2018 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/tag/github/index.html b/tag/github/index.html
index e34eee6..d6ae216 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 32f6887..81fcaba 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 6fb5853..062907e 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -219,7 +219,7 @@
<div id="inner-footer" class="wrap cf">
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2018 Apache Spot.
</p>
</div>
[incubator-spot] 21/45: Documentation and diagram updates
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit e9a03108d185942cc70e2be683746fd65d6f6e51
Author: Cesar <ce...@apache.org>
AuthorDate: Mon Feb 20 01:44:42 2017 -0600
Documentation and diagram updates
---
doc/.DS_Store | Bin 6148 -> 0 bytes
doc/css/style.css | 53 +-
doc/images/1.1_technical_overviewv02.jpg | Bin 114063 -> 62423 bytes
doc/images/bullet.png | Bin 0 -> 974 bytes
doc/images/hybrid_hadoop.png | Bin 0 -> 26704 bytes
.../{ => old images}/1.1_technical_overviewv02.jpg | Bin
doc/images/{ => old images}/hybrid_hadoop.bmp | Bin
doc/images/{ => old images}/pure_hadoop.bmp | Bin
.../pure_hadoop_old.bmp} | Bin 4963738 -> 4963738 bytes
doc/images/pure_hadoop.png | Bin 0 -> 144789 bytes
doc/index.html | 1020 +++++++++-----------
index.html | 24 +-
library/images/advantages-1.png | Bin 37207 -> 54957 bytes
.../{advantages-1.png => advantages-1_old.png} | Bin
14 files changed, 518 insertions(+), 579 deletions(-)
diff --git a/doc/.DS_Store b/doc/.DS_Store
deleted file mode 100644
index 5e89886..0000000
Binary files a/doc/.DS_Store and /dev/null differ
diff --git a/doc/css/style.css b/doc/css/style.css
index f72d094..cc9fcdd 100755
--- a/doc/css/style.css
+++ b/doc/css/style.css
@@ -284,13 +284,13 @@ GRID STYLES
/*********************
GENERAL STYLES
*********************/
-body { font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-size: 100%; line-height: 1.5; color: #0b0b0b; background-color: #f7f7f7; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; }
+body { font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; /*font-size: 100%;*/font-size:10.5pt; line-height: 1.5; color: #0b0b0b; background-color: #ff; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; }
-p { -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; letter-spacing: 1px; line-height: 1.8em; font-size: 11pt; }
+p { -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; letter-spacing: 1px; line-height: 1.8em; font-size: 10.5pt; }
ol {padding-left:20px;font-size:11pt;line-height:1.8em;letter-spacing:1px;}
-ul{padding-left:20px;list-style-image:url('../images/bullet.png');font-size:11pt;line-height:1.8em;letter-spacing:1px;}
+ul{padding-left:20px;list-style-image:url('../images/bullet.png');font-size:11pt;line-height:1.8em;letter-spacing:1px;margin-bottom:25px;}
ul li {margin-bottom:10px;}
img { max-width: 100%; height: auto; }
@@ -301,18 +301,25 @@ img { max-width: 100%; height: auto; }
.desktop {display:none;}
-
+.orange-bold {color:#c97644;font-weight:bold;font-style:italic;}
#configuration .orange-bold {margin-bottom:10px;}
+.short-mrg {margin-bottom:10px;}
/*********************
LAYOUT
*********************/
.wrap { width: 85%; margin: 0 auto; }
#mainwrap {position:relative;}
+.box-shadow {
+-webkit-box-shadow: 4px 4px 10px 0px rgba(50, 50, 50, 0.35);
+-moz-box-shadow: 4px 4px 10px 0px rgba(50, 50, 50, 0.35);
+box-shadow: 4px 4px 10px 0px rgba(50, 50, 50, 0.35);
+margin-bottom:25px;
+}
/*********************
PUSH MENU
*********************/
-.cbp-spmenu button{position:absolute;top:5px;right:2px;margin:15px 5px 0 0;border:none;background-color:transparent;font-size:2em;color:#fff;text-indent:-999999px;background:url('../images/open.png')no-repeat;width:29px;height:30px;padding:0;}
+.cbp-spmenu button{position:absolute;top:5px;right:2px;margin:15px 5px 0 0;border:none;background-color:transparent;font-size:2em;color:#fff;text-indent:-999999px;background:url('../images/open.png')no-repeat;width:29px;height:30px;padding:0;}
.cbp-spmenu.cbp-spmenu-open button {background:url('../images/close.png') no-repeat;}
.cbp-spmenu{background:#d0cbc5;position:absolute;}
.cbp-spmenu h3{color:#ffffff;font-size:1.9em;padding:20px 0 20px 20px;margin:0 0 15px;font-size:16pt;font-weight:500;text-transform:uppercase;font-family:'Open Sans',sans-serif;letter-spacing:0;}
@@ -394,12 +401,16 @@ h1, .h1 { font-size: 2.2em; line-height: 1.333em; }
h2, .h2 { font-size: 1.75em; line-height: 1.4em; margin-bottom: 0.375em; }
-h3, .h3 { font-size: 1.125em; }
+h3, .h3 { font-size: 1.4em; color:#8e8506; margin:15px 0 5px;}
h4, .h4 { font-size: 1.1em; font-weight: 700; }
h5, .h5 { font-size: 0.846em; line-height: 2.09em; text-transform: uppercase; letter-spacing: 2px; }
+.gray {color:#a3a3a1;text-transform:uppercase;margin-bottom:10px;}<p class="short-mrg">
+#configuration .gray {margin-bottom:5px;}
+
+p {margin:0 0 30px;}
/*********************
BUTTON STYLES
*********************/
@@ -472,25 +483,37 @@ FOOTER STYLES
.footer { clear: both; background-color: #363132; color: #f8f9fa; min-height: 50px; }
+.copyright {margin:14px 0;}
/************************
ORIGINAL STYLES
*************************/
img {height: auto;max-width: 100%;}
-p.terminal {background: #000000;border: 2px solid #000000;border-radius: 25px;color: #FFFFFF;margin-left: 50px;margin-right: 100px;padding: 20px;}
-table.configuration {margin-left: 20px;margin-right: 20px;width: 90%;}
-table.configuration th {background-color: #212F3C;color: white;}
-table.configuration td {padding: 8px;text-align: center;}
-table.configuration tr:nth-child(even) {background-color: #f2f2f2;}
-.sidenav {background-color: #212F3C;height: 100%;left: 0;overflow-x: hidden;padding-top: 60px;position: absolute;top: 0;transition: 0.5s;width: 200px;z-index: 1;}
+p.terminal {background: #4b4547;border: 2px solid #4b4547;border-radius: 25px;color: #FFFFFF;margin-left: 0;padding: 20px;}
+table.configuration {margin-left: 20px;margin-right: 20px;width: 90%;table-layout:fixed;}
+table.configuration th {background-color: #212F3C;color: white;padding:10px;}
+table.configuration th:first-of-type {background:#8e8506;}
+table.configuration th:nth-child(2) {background:#807705;}
+table.configuration th:nth-child(3) {background:#797105;}
+table.configuration td {padding: 8px;text-align: center;vertical-align:top;word-wrap:break-word;}
+table.configuration tr:nth-child(2) td {padding-top:25px;}
+table.configuration tr:last-child td {padding-bottom:25px;}
+table.configuration tr td:first-of-type {background-color: #e6e6e6;}
+table.configuration tr td:nth-child(2) {background-color:#cfcfcf;}
+table.configuration tr td:nth-child(3) {background-color:#c4c4c4;}
+table.configuration.config2 tr td:nth-child(2) {font-size:9.5pt !important;}
+
+.sidenav {background-color: #212F3C;height: 100%strong;left: 0;overflow-x: hidden;padding-top: 60px;position: absolute;top: 0;transition: 0.5s;width: 200px;z-index: 1;}
.sidenav a {color: #818181;display: block;font-size: 20px;padding: 8px 8px 8px 32px;text-decoration: none;transition: 0.3s;}
.sidenav li {color: #818181;}
.sidenav a:hover, .offcanvas a:focus {color: #f1f1f1;}
.sidenav .closebtn {font-size: 36px;margin-left: 50px;position: absolute;right: 25px;top: 0;}
-#main {padding: 20px;margin-left:45px;transition: margin-left .5s;}
-
-#main {max-width:100%;overflow:hidden;}
+.main {/*padding: 20px;margin-left:45px;*/padding:20px 20px 20px 65px;transition: margin-left .5s;}
+.main {max-width:100%;overflow:hidden;}
+.main.tan-bg {
+ background:#e8e5e0;
+}
@media only screen and (min-width:768px) {
.wrap { width: 760px; }
diff --git a/doc/images/1.1_technical_overviewv02.jpg b/doc/images/1.1_technical_overviewv02.jpg
index 09451ed..34f452e 100755
Binary files a/doc/images/1.1_technical_overviewv02.jpg and b/doc/images/1.1_technical_overviewv02.jpg differ
diff --git a/doc/images/bullet.png b/doc/images/bullet.png
new file mode 100755
index 0000000..df56eae
Binary files /dev/null and b/doc/images/bullet.png differ
diff --git a/doc/images/hybrid_hadoop.png b/doc/images/hybrid_hadoop.png
new file mode 100755
index 0000000..73a54c4
Binary files /dev/null and b/doc/images/hybrid_hadoop.png differ
diff --git a/doc/images/1.1_technical_overviewv02.jpg b/doc/images/old images/1.1_technical_overviewv02.jpg
similarity index 100%
copy from doc/images/1.1_technical_overviewv02.jpg
copy to doc/images/old images/1.1_technical_overviewv02.jpg
diff --git a/doc/images/hybrid_hadoop.bmp b/doc/images/old images/hybrid_hadoop.bmp
similarity index 100%
rename from doc/images/hybrid_hadoop.bmp
rename to doc/images/old images/hybrid_hadoop.bmp
diff --git a/doc/images/pure_hadoop.bmp b/doc/images/old images/pure_hadoop.bmp
old mode 100644
new mode 100755
similarity index 100%
copy from doc/images/pure_hadoop.bmp
copy to doc/images/old images/pure_hadoop.bmp
diff --git a/doc/images/pure_hadoop.bmp b/doc/images/old images/pure_hadoop_old.bmp
old mode 100644
new mode 100755
similarity index 94%
rename from doc/images/pure_hadoop.bmp
rename to doc/images/old images/pure_hadoop_old.bmp
index b266472..311d0b5
Binary files a/doc/images/pure_hadoop.bmp and b/doc/images/old images/pure_hadoop_old.bmp differ
diff --git a/doc/images/pure_hadoop.png b/doc/images/pure_hadoop.png
new file mode 100755
index 0000000..52a3962
Binary files /dev/null and b/doc/images/pure_hadoop.png differ
diff --git a/doc/index.html b/doc/index.html
index c7280f2..83beeca 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -114,14 +114,14 @@
</nav>
- <div id="main">
+ <div class="main">
<div id="introduction">
<h1>Introduction</h1>
<p>
Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.
<br>
</p>
- <img src="images/1.1_technical_overviewv02.jpg" width="95%"><br><br>
+ <img src="images/1.1_technical_overviewv02.jpg" style="margin:30px 0;" alt="" /><br><br>
<h3>Parallel Ingest Framework.</h3>
<p>
The system uses decoders optimized from open source, that decodes binary flow and packet data, then loading the data in HDFS and data structures inside Hadoop. The decoded data is stored in multiple formats so it is available for searching, used by machine learning, transfer to law enforcement, or inputs to other systems.
@@ -135,15 +135,17 @@
In addition to machine learning, a proven process of context enrichment, noise filtering, whitelisting, and heuristics are applied to network data to produce a short list of the most likely patterns, which may be security threats.<br><br>
</p>
</div>
+ </div>
+ <div class="main tan-bg">
<div id="environment">
<h1>Environment</h1>
- <h3>PURE HADOOP</h3>
+ <h3>Pure Hadoop</h3>
<p>
Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the recommended deployment of CDH (see diagram below).<br><br>
This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.<br><br>
</p>
- <img src="images/pure_hadoop.bmp" width="95%"><br><br>
+ <img src="images/pure_hadoop.png" alt="" /><br><br>
<p>
In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource manage [...]
@@ -155,25 +157,28 @@
<p>
On existing Hadoop installations, a different approach involves using additional virtual machines and interacting with Hadoop components (Spark, HDFS) through a gateway node. This approach is recommended for customers with a Hadoop environment hosting heterogeneous use cases, where minimal deviation from node roles is desired. The disadvantage is that virtual machines must be sized properly according to workloads.<br><br>
</p>
- <img src="images/hybrid_hadoop.bmp" width="95%"><br><br>
+ <img src="images/hybrid_hadoop.png" alt="" /><br><br>
<p>
In addition to the services deployed on the existing cluster, additional Virtual Machines (VMs) are required to host the non-Hadoop functions of the solution. The gateway service is required for some of these VMs to allow for interaction with Spark, Hive, and HDFS.<br><br>
</p>
- <b>Note:</b> While the above condition is a recommended layout for production, pilot deployments may be chosen to combine the above roles into fewer VMs. Each component of the Apache Spot (incubating) solution has integral interactions with Hadoop, but its non-Hadoop processing and memory requirements are separable with this approach.<br><br>
+ <strong>Note:</strong> While the above condition is a recommended layout for production, pilot deployments may be chosen to combine the above roles into fewer VMs. Each component of the Apache Spot (incubating) solution has integral interactions with Hadoop, but its non-Hadoop processing and memory requirements are separable with this approach.<br><br>
</div>
+ </div>
+ <div class="main">
<div id="installation">
<h1>Installation</h1>
<div id="cdh">
This installation guide assumes that a cluster with HDFS is running CDH.<br>
- <h2>1. CDH (Cloudera Distribution of Hadoop) Requirements:</h2>
- <b>Minimum required version:</b> 5.4<br>
- <b>NOTE:</b> Spot requires spark 1.6, if you are using CDH < 5.7 please upgrade your spark version to 1.6.
- <h3>Required Hadoop Services before install apache spot (incubating):</h3>
- <ol>
+ <h3>1. CDH (Cloudera Distribution of Hadoop) Requirements:</h3>
+ <p>
+ <strong>Minimum required version:</strong> 5.4<br>
+ <strong>NOTE:</strong> Spot requires spark 1.6, if you are using CDH < 5.7 please upgrade your spark version to 1.6.</p>
+ <p class="orange-bold" style="margin-bottom:0;">Required Hadoop Services before install apache spot (incubating):</p>
+ <ul>
<li>HDFS.</li>
<li>HIVE.</li>
<li>IMPALA.</li>
@@ -181,16 +186,16 @@
<li>SPARK (YARN).</li>
<li>YARN.</li>
<li>Zookeeper.</li>
- </ol>
+ </ul>
</div>
<div id="deployment">
- <h2>2. Deployment Recommendations</h2>
- There are four components in apache spot (incubating):
+ <h3>2. Deployment Recommendations</h3>
+ <p class="orange-bold" style="margin-bottom:0;">There are four components in apache spot (incubating):</p>
<ul>
- <li><b>spot-setup</b> — scripts that create the required HDFS paths, hive tables and configuration for apache spot (incubating).</li>
- <li><b>spot-ingest</b> — binary and log files are captured or transferred into the Hadoop cluster, where they are transformed and loaded into solution data stores.</li>
- <li><b>spot-ml</b> — machine learning algorithms are used to add additional learning information to the ingest data, which is used to filter and sort raw data.</li>
- <li><b>spot-oa</b>— data output from the machine learning component is augmented with context and heuristics, then is available to the user for interacting with it.</li>
+ <li><strong>spot-setup</strong> — scripts that create the required HDFS paths, hive tables and configuration for apache spot (incubating).</li>
+ <li><strong>spot-ingest</strong> — binary and log files are captured or transferred into the Hadoop cluster, where they are transformed and loaded into solution data stores.</li>
+ <li><strong>spot-ml</strong> — machine learning algorithms are used to add additional learning information to the ingest data, which is used to filter and sort raw data.</li>
+ <li><strong>spot-oa</strong>— data output from the machine learning component is augmented with context and heuristics, then is available to the user for interacting with it.</li>
</ul>
While all of the components can be installed on the same server in a development or test scenario, the recommended configuration for production is to map the components to specific server roles in a Hadoop cluster.<br><br>
<table class="configuration">
@@ -217,32 +222,32 @@
</table>
</div>
<div id="configuration">
- <h2>3. Configuring the cluster.</h2>
- <h3>3.1 Create a user account for apache spot (incubating).</h3>
+ <h3>3. Configuring the cluster.</h3>
+ <h4 class="gray">3.1 Create a user account for apache spot (incubating).</h4>
<p>
Before starting the installation,
the recommended approach is to create a user account with super user privileges (sudo)
and with access to HDFS in each one of the nodes where apache spot (incubating) is going to be installed ( i.e. edge server, yarn node).<br>
</p>
- <b>Add user to all apache spot (incubating) nodes:</b><br><br>
+ <p class="orange-bold">Add user to all apache spot (incubating) nodes:</p>
<p class="terminal">
sudo adduser <solution-user><br>
passwd <solution-user>
</p><br>
- <b>Add user to HDFS supergroup (IMPORTANT: this should be done in the Name Node) :</b><br><br>
+ <p class="orange-bold">Add user to HDFS supergroup (IMPORTANT: this should be done in the Name Node) :</p>
<p class="terminal">
sudo usermod -G supergroup $username
</p><br>
- <h3>3.2 Get the code.</h3>
+ <h4 class="gray">3.2 Get the code.</h4>
Go to the home directory of the solution user in the node assigned for spot-setup and spot-ingest and clone the code:<br><br>
<p class="terminal">
git clone https://github.com/apache/incubator-spot.git
</p><br>
- <h3>3.3 Edit apache spot (incubating) configuration.</h3>
+ <h4 class="gray">3.3 Edit apache spot (incubating) configuration.</h4>
Go to apache spot (incubating) configuration module to edit the solution configuration:<br><br>
<p class="terminal">
cd /home/solution_user/incubator-spot/spot-setup<br>
@@ -250,7 +255,7 @@
</p><br>
Configuration variables of apache spot (incubating):<br><br>
- <table class="configuration">
+ <table class="configuration config2">
<tr>
<th>Key</th>
<th>Value</th>
@@ -412,37 +417,37 @@
</tr>
</table>
<br><br>
- <b>NOTE: deprecated keys will be removed in the next releases.</b><br>
- <b>More details about how to set up Spark properties please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/SPARKCONF.md">Spark Configuration</a></b><br><br>
+ <p><strong>NOTE:</strong> deprecated keys will be removed in the next releases.<br>
+ More details about how to set up Spark properties please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/SPARKCONF.md">Spark Configuration</a></p>
- <h3>3.4 Run spot-setup.</h3>
- Copy the configuration file edited in the previous step to "/etc/" folder.<br>
+ <h4 class="gray">3.4 Run spot-setup.</h4>
+ <p class="short-mrg">Copy the configuration file edited in the previous step to "/etc/" folder.</p>
<p class="terminal">
sudo cp spot.conf /etc/.
- </p><br>
+ </p>
- Copy the configuration to the two nodes named as UINODE and MLNODE.<br>
+ <p class="short-mrg">Copy the configuration to the two nodes named as UINODE and MLNODE.</p>
<p class="terminal">
sudo scp spot.conf solution_user@node:/etc/.
- </p><br>
+ </p>
- Run the hdfs_setup.sh script to create folders in Hadoop for the different use cases (flow, DNS or Proxy), create the Hive database, and finally execute hive query scripts that creates Hive tables needed to access netflow, DNS and proxy data.
+ <p class="short-mrg">Run the hdfs_setup.sh script to create folders in Hadoop for the different use cases (flow, DNS or Proxy), create the Hive database, and finally execute hive query scripts that creates Hive tables needed to access netflow, DNS and proxy data.</p>
<p class="terminal">
./hdfs_setup.sh
- </p><br>
+ </p>
</div>
<div id="ingest">
- <h2>4 Ingest.</h2>
- <h3> 4.1 Ingest Code.</h3>
+ <h3>4 Ingest.</h3>
+ <h4 class="gray"> 4.1 Ingest Code.</h4>
<p>
Copy the ingest folder (spot-ingest) to the selected node for ingest process (i.e. edge server). If you cloned the code in the edge server and you are planning to use the same server for ingest you dont need to copy the folder.
</p>
- <h3>4.2 Ingest dependencies.</h3>
+ <h4 class="gray">4.2 Ingest dependencies.</h4>
<ul>
<li>
- Create a src folder to install all the dependencies.<br>
+ <p class="short-mrg">Create a src folder to install all the dependencies.</p>
<p class="terminal">
cd spot-ingest <br>
mkdir src <br>
@@ -450,26 +455,26 @@
</p><br>
</li>
<li>
- Install pip - python package manager.<br>
+ <p class="short-mrg">Install pip - python package manager.</p>
<p class="terminal">
wget --no-check-certificate https://bootstrap.pypa.io/get-pip.py <br>
sudo -H python get-pip.py
</p><br>
</li>
<li>
- kafka-python (how to install) -- Python client for the Apache Kafka distributed stream processing system.<br>
+ <p class="short-mrg">kafka-python (how to install) -- Python client for the Apache Kafka distributed stream processing system.</p>
<p class="terminal">
sudo -H pip install kafka-python
</p><br>
</li>
<li>
- watchdog - (how to install) Python API library and shell utilities to monitor file system events.<br>
+ <p class="short-mrg">watchdog - (how to install) Python API library and shell utilities to monitor file system events.</p>
<p class="terminal">
sudo -H pip install watchdog
</p><br>
</li>
<li>
- spot-nfdump - netflow dissector tool. This version is a custom version developed for apache spot (incubating) that has special features required for spot-ml.<br>
+ <p class="short-mrg">spot-nfdump - netflow dissector tool. This version is a custom version developed for apache spot (incubating) that has special features required for spot-ml.</p>
<p class="terminal">
sudo yum -y groupinstall "Development Tools"<br>
git clone https://github.com/Open-Network-Insight/spot-nfdump.git <br>
@@ -479,9 +484,8 @@
</p><br>
</li>
<li>
- tshark - DNS dissector tool. For tshark, follow the steps on the web site to install it. Tshark must be downloaded and built from
- <a href="https://www.wireshark.org/download.html"> Wireshark page</a><br>
- Full instructions for compiling Wireshark can be found <a href="https://www.wireshark.org/docs/wsug_html_chunked/ChBuildInstallUnixBuild.html">here</a> instructions for compiling<br>
+ <p class="short-mrg">tshark - DNS dissector tool. For tshark, follow the steps on the web site to install it. Tshark must be downloaded and built from <a href="https://www.wireshark.org/download.html"> Wireshark page</a></p>
+ <p class="short-mrg">Full instructions for compiling Wireshark can be found <a href="https://www.wireshark.org/docs/wsug_html_chunked/ChBuildInstallUnixBuild.html">here</a> instructions for compiling</p>
<p class="terminal">
sudo yum -y install gtk2-devel gtk+-devel bison qt-devel qt5-qtbase-devel sudo yum -y groupinstall "Development Tools"<br>
sudo yum -y install libpcap-devel<br>
@@ -495,18 +499,17 @@
</p><br>
</li>
<li>
- screen -- The screen utility is used to capture output from the ingest component for logging, troubleshooting, etc. You can check if screen is installed on the node.<br>
+ <p class="short-mrg">screen -- The screen utility is used to capture output from the ingest component for logging, troubleshooting, etc. You can check if screen is installed on the node.</p>
<p class="terminal">
which screen
</p><br>
- If screen is not available, install it.
+ <p class="short-mrg">If screen is not available, install it.</p>
<p class="terminal">
sudo yum install screen
</p><br>
</li>
<li>
- Spark-Streaming – Download the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name).
- <b>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</b><br>
+ <p class="short-mrg">Spark-Streaming – Download the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name). <strong>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</strong></p>
<p class="terminal">
cd spot-ingest/common<br>
wget https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-kafka- 0-8-assembly_2.11/2.0.0/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar
@@ -514,65 +517,65 @@
</li>
</ul>
- <h3>4.3 Ingest configuration.</h3>
- Ingest Configuration:<br>
- The file ingest_conf.json contains all the required configuration to start the ingest module
+ <h4 class="gray">4.3 Ingest configuration.</h4>
+ <p class="short-mrg">Ingest Configuration:</p>
+ <p class="short-mrg">The file ingest_conf.json contains all the required configuration to start the ingest module</p>
<ul>
- <li><b>dbname:</b> Name of HIVE database where all the ingested data will be stored in avro-parquet format.</li>
- <li><b>hdfs_app_path:</b> Application path in HDFS where the pipelines will be stored (i.e /user/application_user/).</li>
- <li><b>kafka:</b> Kafka and Zookeeper server information required to create/listen topics and partitions.</li>
- <li><b>collector_processes:</b> Ingest framework uses multiprocessing to collect files (different from workers), this configuration key defines the numbers of collector processes to use.</li>
- <li><b>spark-streaming:</b> Proxy pipeline uses spark streaming to ingest data, this configuration is required to setup the spark application for more details please check : how to configure spark</li>
- <li><b>pipelines:</b> In this section you can add multiple configurations for either the same pipeline or different pipelines. The configuration name must be lowercase without spaces (i.e. flow_internals).</li>
- <li><b>local_staging:</b> (for each pipeline) this path is very important, ingest uses this for tmp files</li>
+ <li><strong>dbname:</strong> Name of HIVE database where all the ingested data will be stored in avro-parquet format.</li>
+ <li><strong>hdfs_app_path:</strong> Application path in HDFS where the pipelines will be stored (i.e /user/application_user/).</li>
+ <li><strong>kafka:</strong> Kafka and Zookeeper server information required to create/listen topics and partitions.</li>
+ <li><strong>collector_processes:</strong> Ingest framework uses multiprocessing to collect files (different from workers), this configuration key defines the numbers of collector processes to use.</li>
+ <li><strong>spark-streaming:</strong> Proxy pipeline uses spark streaming to ingest data, this configuration is required to setup the spark application for more details please check : how to configure spark</li>
+ <li><strong>pipelines:</strong> In this section you can add multiple configurations for either the same pipeline or different pipelines. The configuration name must be lowercase without spaces (i.e. flow_internals).</li>
+ <li><strong>local_staging:</strong> (for each pipeline) this path is very important, ingest uses this for tmp files</li>
</ul>
- For more information about spot ingest please go to <a href="https://github.com/apache/incubator-spot/tree/master/spot-ingest"> spot-ingest</a><br>
+ <p class="short-mrg">For more information about spot ingest please go to <a href="https://github.com/apache/incubator-spot/tree/master/spot-ingest"> spot-ingest</a></p>
</div>
<div id="ml">
- <h2>5. Machine Learning.</h2>
- <h3>5.1 ML code.</h3>
- Copy ML code to the primary ML node, the node will launch Spark application.
+ <h3>5. Machine Learning.</h3>
+ <h4 class="gray">5.1 ML code.</h4>
+ <p class="short-mrg">Copy ML code to the primary ML node, the node will launch Spark application.</p>
<p class="terminal">
scp -r spot-ml "ml-node":/home/"solution-user"/. ssh "ml-node"
mv spot-ml ml
cd /home/"solution-user"/ml
- </p><br>
+ </p>
- <h3>5.1 ML dependencies</h3>
+ <h4 class="gray">5.1 ML dependencies</h4>
<ul>
<li>
- Create a src folder to install all the dependencies.
+ <p class="short-mrg">Create a src folder to install all the dependencies.</p>
<p class="terminal">
mkdir src<br>
cd src
- </p><br>
+ </p>
</li>
- <li>Install sbt -- In order to build Scala code, a SBT installation is required. Please download and install <a href="http://www.scala-sbt.org/download.html">download.</a></li>
+ <li><p class="short-mrg">Install sbt -- In order to build Scala code, a SBT installation is required. Please download and install <a href="http://www.scala-sbt.org/download.html">download.</a></p></li>
<li>
- Build Spark application.
+ <p class="short-mrg">Build Spark application.</p>
<p class="terminal">
cd ml<br>
sbt assembly
- </p><br>
+ </p>
</li>
</ul>
- <b>NOTE: validate spot.conf is already copied to this node in the following path: /etc/spot.conf</b>
+ <p class="short-mrg"><strong>NOTE:</strong> validate spot.conf is already copied to this node in the following path: /etc/spot.conf</p>
</div>
<div id="oa">
- <h2>6. Operational Analytics.</h2>
- <h3>6.1 OA code.</h3>
+ <h3>6. Operational Analytics.</h3>
+ <h4 class="gray">6.1 OA code.</h4>
- Copy spot-oa code to the OA node designed in the configuration file (UINODE).
+ <p class="short-mrg">Copy spot-oa code to the OA node designed in the configuration file (UINODE).</p>
<p class="terminal">
scp -r spot-oa "ml-node":/home/"solution-user"/. <br>
ssh "oa-node"<br>
cd /home/"solution-user"/spot-oa
</p><br>
- <h2>6.2 OA prerequisites.</h2>
- In order to execute this process there are a few prerequisites:
+ <h4 class="gray">6.2 OA prerequisites.</h4>
+ <p class="short-mrg">In order to execute this process there are a few prerequisites:</p>
<ul>
<li>Python 2.7.</li>
<li>spot-ml results. Operational Analytics works and transforms Machine Learning results. The
@@ -580,40 +583,41 @@
<li><a href="https://pypi.python.org/pypi/tld/0.7.6"> TLD 0.7.6</a></li>
</ul>
- <h3>6.3 OA (backend) installation.</h3>
- OA installation consists of the configuration of extra modules or components and creation of a set of files. Depending on the data type that is going to be processed some components are required and other components are not. If users are planning to analyze the three data types supported (Flow, DNS and Proxy) then all components should be configured.
+ <h4 class="gray">6.3 OA (backend) installation.</h4>
+ <p class="short-mrg">OA installation consists of the configuration of extra modules or components and creation of a set of files. Depending on the data type that is going to be processed some components are required and other components are not. If users are planning to analyze the three data types supported (Flow, DNS and Proxy) then all components should be configured.</p>
<ol>
- <li>Add context files. Context files should go into spot-oa/context folder and they should contain network and geo localization context. For more information on context files go to spot- oa/context/
- <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md">README.md</a><br><br></li>
+ <li><p class="short-mrg">Add context files. Context files should go into spot-oa/context folder and they should contain network and geo localization context. For more information on context files go to spot- oa/context/ <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md">README.md</a><br></p></li>
<li>
- Add a file ipranges.csv: Ip ranges file is used by OA when running data type Flow. It should contain a list of ip ranges and the label for the given range, example:
+ <p class="short-mrg">Add a file ipranges.csv: Ip ranges file is used by OA when running data type Flow. It should contain a list of ip ranges and the label for the given range, example:</p>
<p class="terminal">
10.0.0.1,10.255.255.255,Internal
- </p><br>
+ </p>
</li>
<li>
- Add a file iploc.csv: Ip localization file used by OA when running data type Flow. Create a csv file with ip ranges in integer format and give the coordinates for each range.<br><br>
+ <p class="short-mrg">Add a file iploc.csv: Ip localization file used by OA when running data type Flow. Create a csv file with ip ranges in integer format and give the coordinates for each range.</p>
</li>
<li>
- Add a file networkcontext_1.csv: Ip names file is used by OA when running data type DNS and Proxy. This file should contains two columns, one for Ip the other for the name, example:
+ <p class="short-mrg">Add a file networkcontext_1.csv: Ip names file is used by OA when running data type DNS and Proxy. This file should contains two columns, one for Ip the other for the name, example:</p>
<p class="terminal">
10.192.180.150, AnyMachine <br>
10.192.1.1, MySystem
- </p><br>
+ </p>
</li>
<li>
- The spot-setup project contains scripts to install the hive database and also includes the main configuration file for this tool. The main file is called spot.conf which contains different variables that the user can set up to customize their installation. Some variables must be updated in order to have spot-ml and spot-oa working.<br><br>
- To run the OA process it's required to install spot-setup. If it's already installed just make sure the following configuration are set up in spot.conf file (oa node).<br><br>
- <b>LUSER:</b> represents the home folder for the user in the Machine Learning node. It's used to know where to return feedback.<br>
- <b>HUSER:</b> represents the HDFS folder. It's used to know from where to get Machine Learning results.<br>
- <b>IMPALA_DEM:</b> represents the node running Impala daemon. It's needed to execute Impala queries in the OA process.<br>
- <b>DBNAME:</b> Hive database, the name is required for OA to execute queries against this database. LPATH: represents the local path where the feedback is going to be sent, it actually works with LUSER.<br><br>
+ <p class="short-mrg">The spot-setup project contains scripts to install the hive database and also includes the main configuration file for this tool. The main file is called spot.conf which contains different variables that the user can set up to customize their installation. Some variables must be updated in order to have spot-ml and spot-oa working.</p>
+ <p class="short-mrg">To run the OA process it's required to install spot-setup. If it's already installed just make sure the following configuration are set up in spot.conf file (oa node).</p>
+ <ul>
+ <li><strong>LUSER:</strong> represents the home folder for the user in the Machine Learning node. It's used to know where to return feedback.</li>
+ <li><strong>HUSER:</strong> represents the HDFS folder. It's used to know from where to get Machine Learning results.</li>
+ <li><strong>IMPALA_DEM:</strong> represents the node running Impala daemon. It's needed to execute Impala queries in the OA process.</li>
+ <li><strong>DBNAME:</strong> Hive database, the name is required for OA to execute queries against this database. LPATH: represents the local path where the feedback is going to be sent, it actually works with LUSER.</li>
+ </ul>
</li>
<li>
- Configure components. Components are python modules included in this project that add context and details to the data being analyzed. There are five components and while not all components are required to every data type, it's recommended to configure all of them in case new data types are analyzed in the future. For more details about how to configure each component go to <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/components/READM [...]
+ <p class="short-mrg">Configure components. Components are python modules included in this project that add context and details to the data being analyzed. There are five components and while not all components are required to every data type, it's recommended to configure all of them in case new data types are analyzed in the future. For more details about how to configure each component go to <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa [...]
</li>
<li>
- You need to update the engine.json file accordingly:
+ <p class="short-mrg">You need to update the engine.json file accordingly:</p>
<p class="terminal">
{
"oa_data_engine":"<database engine>",
@@ -622,60 +626,58 @@
},
"hive":{}
}
- </p><br>
- Where:
+
+ </p>
+ <p class="short-mrg">Where:</p>
<ul>
<li>: Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the following keys, where you'll need to add the corresponding node name.<br></li>
<li>: The node name in your cluster where you have the database service running.</li>
</ul>
</li>
</ol>
- For more information please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md"> https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md</a>
+ <p class="short-mrg">For more information please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md"> https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md</a></p>
- <h2>6.4 Visualization.</h2>
- <p>
- Apache Spot (incubating) - User Interface (aka Spot UI or UI) Provides tools for interactive visualization, noise filters, white listing, and attack heuristics.<br><br>
- Here you will find instructions to get Spot UI up and running. For more information about Spot look here.<br><br>
- </p>
+ <h3>6.4 Visualization.</h3>
+ <p>Apache Spot (incubating) - User Interface (aka Spot UI or UI) Provides tools for interactive visualization, noise filters, white listing, and attack heuristics.</p>
+ <p>Here you will find instructions to get Spot UI up and running. For more information about Spot look here.</p>
- <h2>6.5 Visualization requirements.</h2>
+ <h3>6.5 Visualization requirements.</h3>
<ul>
<li>IPython with notebook module enabled (== 3.2.0) <a href="https://ipython.org/ipython-doc/3/index.html"> link</a></li>
<li>NPM - Node Package Manager <a href="https://www.npmjs.com"> link</a></li>
<li>spot-oa output > Spot UI takes any output from spot-oa backend, as input for the visualization tools provided. Please make sure there are files available under PATH_TO_SPOT/ui/data/${PIPELINE}/${DATE}/</li>
</ul>
- <h2>6.6 Install visualization.</h2>
+ <h3>6.6 Install visualization.</h3>
<ol>
<li>
- Go to Spot UI folder:
- <p class="terminal">cd spot-oa/ui</p><br>
+ <p class="short-mrg">Go to Spot UI folder:</p>
+ <p class="terminal">cd spot-oa/ui</p>
</li>
<li>
- With root privileges, install browserify and uglify as global commands on your system.
- <p class="terminal">npm install –g browserify uglifyjs</p><br>
+ <p class="short-mrg">With root privileges, install browserify and uglify as global commands on your system.</p>
+ <p class="terminal">npm install –g browserify uglifyjs</p>
</li>
<li>
- Install dependencies and build Spot UI.
- <p class="terminal">npm install</p><br>
+ <p class="short-mrg">Install dependencies and build Spot UI.</p>
+ <p class="terminal">npm install</p>
</li>
</ol>
</div>
</div>
+ </div>
+ <div class="main tan-bg">
<div id="userguide">
<h1>User Guide</h1>
<div id="uflow">
- <h2>Flow</h2>
+ <h3>Flow</h3>
<div id="fsc">
- <h3>Suspicious Connects</h3>
- <p>
- Access the analyst view for Suspicious Connects <b>http://"server-ip":8889/files/ui/flow/suspicious.html</b> .
- Select the date that you want to review (defaults to current date). <br>
- Your view should look similar to the one below:<br><br>
- </p>
- <img src="images/1.1sc1.jpg">
- <p>
- Suspicious Connects Web Page contains 4 frames with different functions and information:
+ <h4 class="gray" style="margin-top:0;">Suspicious Connects</h4>
+ <p class="short-mrg">Access the analyst view for Suspicious Connects <strong>http://"server-ip":8889/files/ui/flow/suspicious.html</strong>. Select the date that you want to review (defaults to current date).</p>
+ <p class="short-mrg">Your view should look similar to the one below:</p>
+ <img src="images/1.1sc1.jpg" class="box-shadow" alt="" />
+ <p class="short-mrg">
+ Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
<ul>
<li>Suspicious</li>
@@ -685,9 +687,9 @@
</ul>
</p>
- <h3>The Suspicious frame</h3>
- <p>
- Located in the top left corner of the Suspicious Connects Web Page, this frame presents the Top 250 Suspicious Connections in a table format based on Machine Learning (ML) output. These are the columns depicted in this table:
+ <h4 class="gray">The Suspicious frame</h4>
+ <p class="short-mrg">
+ Located in the top left corner of the Suspicious Connects Web Page, this frame presents the Top 250 Suspicious Connections in a table format based on Machine Learning (ML) output. These are the columns depicted in this table:</p>
<ul>
<li>Rank - ML output rank</li>
<li>Time - Time received field for Netflow record</li>
@@ -700,73 +702,57 @@
<li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
</ul>
</p>
- <p>
- <b>Additional functionality in Suspicious frame</b>
+ <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Suspicious frame</strong>
<ol>
<li>
By selecting a specific row within the Suspicious frame, the connection in the Network View will be highlighted.<br><br>
- <img src="images/1.1_sc2.jpg"><br><br>
+ <img src="images/1.1_sc2.jpg" class="box-shadow" alt="" />
</li>
<li>
- In addition, by performing this row selection the Details Frame presents all the Netflow records in between Source & Destination IP Addresses that happened in the same minute as the Suspicious Record selected<br><br>
- <img src="images/1.1_sc3.jpg"><br><br>
+ In addition, by performing this row selection the Details Frame presents all the Netflow records in between Source & Destination IP Addresses that happened in the same minute as the Suspicious Record selected<br><br>
+ <img src="images/1.1_sc3.jpg" class="box-shadow" alt="" />
</li>
<li>
Next to a Source/Destination IP Addresses, a shield icon might be present. This icon denotes any reputation services value context added as part of the Operational Analytics component. By rolling over you can see the IP Address Reputation result<br><br>
- <img src="images/1.1_sc4.jpg"><br><br>
+ <img src="images/1.1_sc4.jpg" class="box-shadow" alt="" />
</li>
<li>
An additional icon next to the IP addresses within the Suspicious frame is the globe icon. This icon denotes Geo-localization information context added as part of the Operational Analytics component. By rolling over you can see the additional information<br><br>
- <img src="images/1.1_sc5.jpg"><br><br>
+ <img src="images/1.1_sc5.jpg" class="box-shadow" alt="" /><br><br>
</li>
</ol>
</p>
- <h3>The Network View frame</h3>
- <p>
- Located at the top right corner of the Suspicious Connects Web Page. It is a graphical representation of the Suspicious records relationships.
- If context has been added, Internal IP Addresses will be presented as diamonds and External IP Addresses as circles.<br><br>
- </p>
- <img src="images/1.1_sc6.jpg"><br><br>
- <p>
- <b>Additional functionality in Network View frame</b>
+ <h4 class="gray">The Network View frame</h4>
+ <p class="short-mrg">Located at the top right corner of the Suspicious Connects Web Page. It is a graphical representation of the Suspicious records relationships.</p>
+ <p class="short-mrg">If context has been added, Internal IP Addresses will be presented as diamonds and External IP Addresses as circles.</p>
+ <img src="images/1.1_sc6.jpg" class="box-shadow" alt="" /><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Network View frame</p>
<ol>
<li>
- As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.<br><br>
- <img src="images/1.1_sc7.jpg"><br><br>
+ <p class="short-mrg">As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.</p>
+ <img src="images/1.1_sc7.jpg" class="box-shadow" alt="" />
</li>
<li>
- A primary mouse click over one of the nodes will bring a chord diagram into the Details frame.
- The chord diagram is a graphical representation of the connections between the selected node and other nodes within Suspicious Connects records,
- providing number of Bytes From & To. You can move your mouse over an IP to get additional information. In addition,
- drag the chord graph to change its orientation.<br><br>
- <img src="images/1.1_sc8.jpg"><br><br>
+ <p class="short-mrg">A primary mouse click over one of the nodes will bring a chord diagram into the Details frame.</p>
+ <p class="short-mrg">The chord diagram is a graphical representation of the connections between the selected node and other nodes within Suspicious Connects records, providing number of Bytes From & To. You can move your mouse over an IP to get additional information. In addition, drag the chord graph to change its orientation.</p>
+ <img src="images/1.1_sc8.jpg" class="box-shadow" alt="" />
</li>
<li>
- A secondary mouse click uses the node information in order to apply an IP filter to the Suspicious Web Page.<br><br>
- <img src="images/1.1_sc9.jpg"><br><br>
+ <p class="short-mrg">A secondary mouse click uses the node information in order to apply an IP filter to the Suspicious Web Page.</p>
+ <img src="images/1.1_sc9.jpg" class="box-shadow" alt="" />
</li>
</ol>
- </p>
- <h3>The Notebook frame</h3>
- <p>
- This frame contains an initialized Jupyter Notebook. The main function is to allow the Analyst to score IP Addresses and Ports with different values.
- In order to assign a risk to a specific connection, select it using a combination of all the combo boxes,
- select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.
- Selecting a value from each list will narrow down the coincidences, therefore if the analyst wishes to score all connections with one same relevant attribute (i.e. src port 80),
- then select only the combo boxes that are relevant and leave the rest at the first row at the top.
- </p>
- <img src="images/1.1_sc10.jpg"><br><br>
+ <h4 class="gray">The Notebook frame</h4>
+ <p class="short-mrg">This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score IP Addresses and Ports with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, there [...]
+ <img src="images/1.1_sc10.jpg" class="box-shadow" alt="" />
- <h3>The Score button</h3>
- <p>
- When the Analyst clicks on the Score button, the action will find all coincidences exactly matching the selected values and update their score to the rating selected in the radio button list.
- </p>
+ <h4 class="gray">The Score button</h4>
+ <p class="short-mrg">When the Analyst clicks on the Score button, the action will find all coincidences exactly matching the selected values and update their score to the rating selected in the radio button list.</p>
- <h3>The Save button</h3>
- <p>
- Analysts must use Save button in order to store the scored connections. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page, including from the lists in the notebook. This will also reorder the flow_scores.csv file to move all scored connections to the end of the file and sort the rest by severity value. A shell script will be executed to copy the fil [...]
+ <h4 class="gray">The Save button</h4>
+ <p class="short-mrg">Analysts must use Save button in order to store the scored connections. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page, including from the lists in the notebook. This will also reorder the flow_scores.csv file to move all scored connections to the end of the file and sort the rest by severity value. A shell script will be execute [...]
<ul>
<li>LPATH</li>
@@ -774,205 +760,175 @@
<li>LUSER</li>
</ul>
- For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.
- </p>
+ <p class="short-mrg">For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
- <h3>The Quick IP Scoring box</h3>
- <p>
- This box allows the Analyst to enter an IP Address and scored using the "Score" and "Save" buttons using the same process depicted above
- </p>
+ <h4 class="gray">The Quick IP Scoring box</h4>
+ <p class="short-mrg">This box allows the Analyst to enter an IP Address and scored using the "Score" and "Save" buttons using the same process depicted above.</p>
- <h3>Suspicious Connects Web Page Input files</h3>
+ <h4 class="gray">Suspicious Connects Web Page Input files</h4>
<ul>
<li>flow_scores.csv</li>
<li>flow_scores_bu.csv</li>
</ul>
</div>
<div id="fti">
- <h3>Threat Investigation</h3>
- <p>
- Access the analyst view for suspicious connects <b>http://"server-ip":8889/files/ui/flow/suspicious.html.</b>
- Select the date that you want to review. <br>
- Your screen should now look like this:<br><br>
- <img src="images/1.1sc1.jpg"><br><br>
+ <h4 class="gray">Threat Investigation</h4>
+ <p class="short-mrg">Access the analyst view for suspicious connects <strong>http://"server-ip":8889/files/ui/flow/suspicious.html.</strong></p>
+ <p class="short-mrg">Select the date that you want to review.</p>
+ <p class="short-mrg">Your screen should now look like this:</p>
+ <img src="images/1.1sc1.jpg" class="box-shadow" alt="" />
- The analyst must score the suspicious connections before moving into Threat Investigation View,
- please refer to <a href="#fsc">Suspicious Connects Analyst View</a> walk-through <br>
- Select <b>Flows > Threat Investigation </b> from apache spot (incubating) Menu.<br><br>
- <img src="images/1.1_ti01.jpg"><br><br>
-
- <b>Threat Investigation</b> Web Page will be opened, loading the embedded Jupyter notebook.<br><br>
- <img src="images/1.1_ti02.jpg"><br><br>
-
- <h3>Expanded search</h3>
- <p>
- You can select any IP from the list and click <b>Search</b> to view specific details about it. A query to the flow table will be executed looking into the raw data initially collected to find all communication between this and any other IP Addresses during the day, collecting additional information, such as:
-
- <ul>
- <li>max & avg number of bytes sent/received</li>
- <li>max & avg number of packets sent/received</li>
- <li>destination port</li>
- <li>source port</li>
- <li>first & last connection time</li>
- <li>count of connections</li>
- </ul>
-
- The full output of this query is stored into the ir-<ip>.csv file. If an expanded search was previously executed on this IP, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used.<br><br>
-
- Based on the results in this file, the following functions will be executed:<br><br>
+ <p class="short-mrg">The analyst must score the suspicious connections before moving into Threat Investigation View, please refer to <a href="#fsc">Suspicious Connects Analyst View</a> walk-through.</p>
+
+ <p class="short-mrg">Select <strong>Flows > Threat Investigation </strong> from apache spot (incubating) Menu.</p>
+
+ <img src="images/1.1_ti01.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg"><strong>Threat Investigation</strong> Web Page will be opened, loading the embedded IPython notebook.</p>
+ <img src="images/1.1_ti02.jpg" class="box-shadow" alt="" />
+
+ <h4 class="gray">Expanded search</h4>
+ <p class="short-mrg">You can select any IP from the list and click <strong>Search</strong> to view specific details about it. A query to the flow table will be executed looking into the raw data initially collected to find all communication between this and any other IP Addresses during the day, collecting additional information, such as:</p>
+
+ <ul>
+ <li>max & avg number of bytes sent/received</li>
+ <li>max & avg number of packets sent/received</li>
+ <li>destination port</li>
+ <li>source port</li>
+ <li>first & last connection time</li>
+ <li>count of connections</li>
+ </ul>
+
+ <p class="short-mrg">The full output of this query is stored into the ir-<ip>.csv file. If an expanded search was previously executed on this IP, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used.</p>
+
+ <p class="short-mrg">Based on the results in this file, the following functions will be executed:</p>
- <ul>
- <li>get_in_out_and_twoway_conns</li>
- <li>add_geospatial_info()</li>
- <li>add_network_context()</li>
- </ul>
-
- The system will create three dictionaries, each containing:<br><br>
- <ul>
- <li>Inbound connections (when the suspicious IP acts only as destination)</li>
- <li>Outbound connections (when the suspicious IP acts only as source)</li>
- <li>2Way Connections (when the suspicious IP acts as both source and destination)</li>
-
- </ul>
-
- If an iploc.csv file is available, each dictionary will be updated with the geolocation data for each IP.<br>
- If a network_context_1.txt file is available, a description for each identified node will also be added to each dictionary.<br><br>
-
- The connections dictionary will be separated into two smaller dictionaries, each containing<br><br>
- <ul>
- <li>Top 'n' IP's per number of connections.</li>
- <li>Top 'n' IP's per bytes transferred.</li>
- <li>The number of results stored in the dictionaries (n) can be set by updating the value of the top_results variable.</li>
- </ul>
- </p>
-
- <h3>Save Comments</h3>
- <p>
- In addition, a web form is displayed under the title of 'Threat summary',
- where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.<br><br>
- Click on the Save button after entering the data to write it into a CSV file, which eventually will be used in the Storyboard Analyst View.<br><br>
- <img src="images/1.1_ti03.jpg"><br><br>
- </p>
-
- <p>
- After creating the csv file with the analysis description,
- the following functions will generate all graphs and diagrams related to the IP under investigation,
- to populate the Storyboard Analyst view.<br><br>
-
- <ul>
- <li>generate_attack_map_file(anchor_ip, top_inbound_b, outbound, twoway)</li>
- <li>generate_stats(anchor_ip, top_inbound_b, outbound, twoway, threat_name)</li>
- <li>generate_dendro(anchor_ip, top_inbound_b, outbound, twoway, date)</li>
- <li>details_inbound(anchor_ip,top_inbound_b)</li>
- </ul>
-
- <b>generate_attack_map_file()</b> - create a globe map indicating the trajectory of the connections based on their geolocation.
- This function depends on having geolocation data for each IP. If you haven't set up a geolocation database file, the map file won't be generated.<br>
- <b>Output:</b> globe_<ip>.json<br><br>
-
- <b>generate_stats()</b> - This will create the horizontal bar graph for the Impact Analysis.
- This will represent the number of inbound, outbound and twoway connections found.<br>
- <b>Output:</b> stats-<ip>.json<br><br>
-
- <b>generate_dendro()</b> - This function creates a file linking all different IP's that have connected to the IP under investigation,
- this will be displayed in the Storyboard under the Incident Progression panel as a dendrogram.
- If no network context file is included, the dendrogram will only be 1 level deep, but if a network context file is included,
- additional levels will be added to the dendrogram to break down the threat activity.<br>
- <b>Output:</b> dendro-<ip>.json<br><br>
-
- <b>details_inbound()</b> - This function executes a query to the flow table, to find additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br>
- <b>Output:</b> sbdet-<ip>.tsv<br><br>
-
- <b>add_threat()</b> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed.
- This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br>
- <b>Output:</b> threats.csv<br><br>
-
- Each function will print a message to let you know if its output file was successfully updated.<br><br>
-
- <h3>Continue to the Storyboard</h3>
- <p>
- Once you have saved comments on any suspicious IP, you can continue to the Storyboard to check the results.
-
- <b>Input files</b>
- <ul>
- <li>flow_scores.csv</li>
- <li>iploc.csv</li>
- <li>network_context_1.txt</li>
- </ul>
-
- <b>Output files</b>
- <ul>
-
- <li>/oni-oa/data/flow/<date>/threats.csv</li>
- <li>/oni-oa/data/flow/<date>/threat_<ip>.csv</li>
- <li>/oni-oa/data/flow/<date>/sbdet-<ip>.tsv</li>
- <li>/oni-oa/data/flow/<date>/globe_<ip>.json</li>
- <li>/oni-oa/data/flow/<date>/stats-<ip>.json</li>
- <li>/oni-oa/data/flow/<date>/dendro-<ip>.json</li>
- </ul>
- </p>
-
- <b>HDFS tables consumed:</b> flow
- </p>
- </p>
+ <ul>
+ <li>get_in_out_and_twoway_conns</li>
+ <li>add_geospatial_info()</li>
+ <li>add_network_context()</li>
+ </ul>
+
+ <p class="short-mrg">The system will create three dictionaries, each containing:</p>
+ <ul>
+ <li>Inbound connections (when the suspicious IP acts only as destination)</li>
+ <li>Outbound connections (when the suspicious IP acts only as source)</li>
+ <li>2Way Connections (when the suspicious IP acts as both source and destination)</li>
+
+ </ul>
+
+ <p class="short-mrg">If an iploc.csv file is available, each dictionary will be updated with the geolocation data for each IP.</p>
+
+ <p class="short-mrg">If a network_context_1.txt file is available, a description for each identified node will also be added to each dictionary.</p>
+
+ <p class="short-mrg">The connections dictionary will be separated into two smaller dictionaries, each containing</p>
+ <ul>
+ <li>Top 'n' IP's per number of connections.</li>
+ <li>Top 'n' IP's per bytes transferred.</li>
+ <li>The number of results stored in the dictionaries (n) can be set by updating the value of the top_results variable.</li>
+ </ul>
+
+ <h4 class="gray">Save Comments</h4>
+ <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
+ <p class="short-mrg">Click on the Save button after entering the data to write it into a CSV file, which eventually will be used in the Storyboard Analyst View.</p>
+ <img src="images/1.1_ti03.jpg" class="box-shadow" alt="" />
+ <p class="short-mrg">After creating the csv file with the analysis description, the following functions will generate all graphs and diagrams related to the IP under investigation, to populate the Storyboard Analyst view.</p>
+
+ <ul>
+ <li>generate_attack_map_file(anchor_ip, top_inbound_b, outbound, twoway)</li>
+ <li>generate_stats(anchor_ip, top_inbound_b, outbound, twoway, threat_name)</li>
+ <li>generate_dendro(anchor_ip, top_inbound_b, outbound, twoway, date)</li>
+ <li>details_inbound(anchor_ip,top_inbound_b)</li>
+ </ul>
+
+ <p><strong>generate_attack_map_file()</strong> - create a globe map indicating the trajectory of the connections based on their geolocation. This function depends on having geolocation data for each IP. If you haven't set up a geolocation database file, the map file won't be generated.<br><strong>Output:</strong> globe_<ip>.json</p>
+
+ <p><strong>generate_stats()</strong> - This will create the horizontal bar graph for the Impact Analysis.This will represent the number of inbound, outbound and twoway connections found.<br>
+ <strong>Output:</strong> stats-<ip>.json</p>
+
+ <p><strong>generate_dendro()</strong> - This function creates a file linking all different IP's that have connected to the IP under investigation, this will be displayed in the Storyboard under the Incident Progression panel as a dendrogram. If no network context file is included, the dendrogram will only be 1 level deep, but if a network context file is included, additional levels will be added to the dendrogram to break down the threat activity.<br>
+ <strong>Output:</strong> dendro-<ip>.json</p>
+
+ <p><strong>details_inbound()</strong> - This function executes a query to the flow table, to find additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br>
+ <strong>Output:</strong> sbdet-<ip>.tsv</p>
+
+ <p><strong>add_threat()</strong> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed. This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br><strong>Output:</strong> threats.csv</p>
+
+ <p>Each function will print a message to let you know if its output file was successfully updated.</p>
+
+ <h4 class="gray">Continue to the Storyboard</h4>
+ <p>Once you have saved comments on any suspicious IP, you can continue to the Storyboard to check the results.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
+ <ul>
+ <li>flow_scores.csv</li>
+ <li>iploc.csv</li>
+ <li>network_context_1.txt</li>
+ </ul>
+
+ <p class="orange-bold" style="margin-bottom:0;">Output files</p>
+ <ul>
+
+ <li>/oni-oa/data/flow/<date>/threats.csv</li>
+ <li>/oni-oa/data/flow/<date>/threat_<ip>.csv</li>
+ <li>/oni-oa/data/flow/<date>/sbdet-<ip>.tsv</li>
+ <li>/oni-oa/data/flow/<date>/globe_<ip>.json</li>
+ <li>/oni-oa/data/flow/<date>/stats-<ip>.json</li>
+ <li>/oni-oa/data/flow/<date>/dendro-<ip>.json</li>
+ </ul>
+
+ <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
+ <ul>
+ <li>flow</li>
+ </ul>
+
</div>
<div id="fsb">
- <h3>Storyboard</h3>
+ <h4 class="gray">Storyboard</h4>
<ol>
<li>
- Select the option <b>Flow > Storyboard</b> from Apache Spot (incubating) Menu.<br><br>
- <img src="images/sb_tit1.JPG"><br><br>
- </li>
- <li>
- Your view should look something like this, depending on the IP's you have analyzed on the Threat Analysis for that day.
- You can select a different date from the calendar.<br><br>
- <img src="images/flow_sb_1.JPG"><br><br>
+ <p class="short-mrg">Select the option <strong>Flow > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/sb_tit1.JPG" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Your view should look something like this, depending on the IP's you have analyzed on the Threat Analysis for that day. You can select a different date from the calendar.</p>
+ <img src="images/flow_sb_1.JPG" class="box-shadow" alt="" />
</li>
<li>
- Review the results:<br><br>
+ <p class="short-mrg">Review the results:</p>
- <b>Executive Threat Briefing</b><br>
- <b>Data source file:</b> threats.csv
- Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook.
- You can click on any title and the additional information will be displayed.<br><br>
- <img src="images/flow_sb_2.JPG" style="width: 50%"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
+ <p class="short-mrg"><strong>Data source file:</strong> threats.csv Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and the additional information will be displayed.</p>
+ <p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.JPG" class="box-shadow" alt="" /></p>
- Clicking on a threat from the list will also update the additional frames.<br><br>
+ <p class="short-mrg">Clicking on a threat from the list will also update the additional frames.</p>
- <b>Incident Progression</b><br>
- <b>Data source file:</b> dendro-<ip>.json<br>
- Frame located in the top right of the Storyboard Web page<br><br>
- <img src="images/flow_sb_3.JPG"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Incident Progression</p>
+ <p class="short-mrg"><strong>Data source file:</strong> dendro-<ip>.json<br>Frame located in the top right of the Storyboard Web page</p>
+ <img src="images/flow_sb_3.JPG" class="box-shadow" alt="" />
- Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.
- When network context is available, this graph will present an extra level to break down each type of connection into detailed context.<br><br>
+ <p class="short-mrg">Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
+ <p class="short-mrg">When network context is available, this graph will present an extra level to break down each type of connection into detailed context.</p>
- <b>Impact Analysis</b>
- <b>Data source file:</b> stats-<ip>.json<br><br>
- <img src="images/flow_sb_4.JPG" style="width: 50%"><br><br>
+ <p class="short-mrg"><strong>Impact Analysis Data source file:</strong> stats-<ip>.json</p>
+ <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_4.JPG" class="box-shadow" alt="" /></p>
- Impact Analysis displays a horizontal bar graph representing the number of inbound, outbound and two-way connections found related to the threat.
- Clicking any bar in the graph, will break down that information into its context.<br><br>
+ <p class="short-mrg">Impact Analysis displays a horizontal bar graph representing the number of inbound, outbound and two-way connections found related to the threat. Clicking any bar in the graph, will break down that information into its context.</p>
- <b>Map View | Globe</b><br>
- <b>Data source file:</b> globe_<ip>.json<br><br>
- <img src="images/flow_sb_5.JPG" style="width: 50%"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Map View | Globe</p>
+ <p class="short-mrg"><strong>Data source file:</strong> globe_<ip>.json</p>
+ <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_5.JPG" class="box-shadow" alt="" /></p>
- Map View Globe will only be created if you have a geolocation database.
- This is intended to represent on a global scale the communication detected,
- using the geolocation data of each IP to print lines on the map showing the flow of the data.<br><br>
+ <p class="short-mrg">Map View Globe will only be created if you have a geolocation database. This is intended to represent on a global scale the communication detected, using the geolocation data of each IP to print lines on the map showing the flow of the data.</p>
- <b>Timeline</b><br>
- <b>Data source file:</b> sbdet-<ip>.json<br><br>
- <img src="images/flow_sb_6.JPG" style="width: 50%"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Timeline</p>
+ <p class="short-mrg"><strong>Data source file:</strong> sbdet-<ip>.json</p>
+ <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_6.JPG" class="box-shadow" alt="" /></p>
- Timeline is created using the resulting connections found during the Threat Investigation process.
- It will display 'clusters' of inbound connections to the IP, grouped by time;
- showing an overall idea of the times during the day with the most activity.
- You can zoom in or out into the graphs timeline using your mouse scroll.<br><br>
+ <p class="short-mrg">Timeline is created using the resulting connections found during the Threat Investigation process. It will display 'clusters' of inbound connections to the IP, grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll.</p>
- <b>Input files</b><br><br>
+ <p class="short-mrg"><strong>Input files</strong></p>
<ul>
<li>threats.csv</li>
<li>threat-dendro-${id}.json</li>
@@ -984,19 +940,19 @@
</ol>
</div>
<div id="fis">
- <h3>Ingest Summary</h3>
+ <h4 class="gray">Ingest Summary</h4>
<ol>
<li>
- Load the Ingest Summary page by going to <b>http://"server-ip":8889/files/index_ingest.html </b> or using the drop down menu.<br><br>
- <img src="images/is1.png"><br><br>
+ <p class="short-mrg">Load the Ingest Summary page by going to <strong>http://"server-ip":8889/files/index_ingest.html</strong> or using the drop down menu.</p>
+ <img src="images/is1.png" class="box-shadow" alt="" />
</li>
<li>
- Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days.
- Your view should now look like this:<br><br>
- <img src="images/is2.png"><br><br>
+ <p class="short-mrg">Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days.
+ Your view should now look like this:</p>
+ <img src="images/is2.png" class="box-shadow" alt="" />
</li>
<li>
- Ingest Summary presents the Flows ingestion timeline, showing the total flows for a particular period of time.<br><br>
+ <p class="short-mrg">Ingest Summary presents the Flows ingestion timeline, showing the total flows for a particular period of time.</p>
<ul>
<li>Analyst can zoom in/out on the graph.</li>
<li>Analyst can zoom in/out on the graph.</li>
@@ -1006,69 +962,58 @@
</div>
</div>
<div id="udns">
- <h2>DNS</h2>
+ <h3>DNS</h3>
<div id="dsc">
- <h3>Suspicious DNS</h3>
+ <h4 class="gray" style="margin-top:0;">Suspicious DNS</h4>
<ol>
<li>
- <b>Open the analyst view for Suspicious DNS:</b> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).<br>
- Your screen should now look like this:<br><br>
- <img src="images/1.1_dns_sc01.jpg"><br><br>
+ <p><strong>Open the analyst view for Suspicious DNS:</strong> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).</p>
+ <p class="short-mrg">Your screen should now look like this:</p>
+ <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
</li>
<li>
- <b>The Suspicious <frame:></frame:></b>
- <p>
- Located at the top left of the Web page, this frame shows the top 250 suspicious DNS from the Machine Learning (ML) output.<br><br>
- <ol>
- <li>By moving the mouse over a suspicious DNS,
- you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
- </li>
- <li>
- Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
- The icon will change its color depending upon the results from specific reputation services.<br><br>
- </li>
- <li>
- By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame.
- In addition Details frame will be populated with additional communications directed to the same DNS record.<br><br>
- </li>
- </ol>
- </p>
+ <p class="short-mrg"><strong>The Suspicious</strong><br>Located at the top left of the Web page, this frame shows the top 250 suspicious DNS from the Machine Learning (ML) output.</p>
+ <ol>
+ <li>By moving the mouse over a suspicious DNS,
+ you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
+ </li>
+ <li>
+ Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
+ The icon will change its color depending upon the results from specific reputation services.<br><br>
+ </li>
+ <li>
+ By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame.
+ In addition Details frame will be populated with additional communications directed to the same DNS record.<br><br>
+ </li>
+ </ol>
</li>
<li>
- <b>The Network View frame</b><br><br>
- <p>
- Located at the top right corner, Network View is a graphic representation of the "Suspicious DNS".<br><br>
- <ol>
- <li>As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br></li>
- <li>Diamonds represents DNS records and circles represents IP addresses communicating to the respective DNS record<br><br></li>
- <li>A primary mouse click in an IP Address (circle) will bring a diagram within Details frame, providing all the Domain Name records queried by that particular IP Address<br><br></li>
- <li>A secondary mouse click uses the node information to filter suspicious data.<br><br></li>
- </ol>
- </p>
+ <p class="short-mrg"><strong>The Network View frame</strong><br>Located at the top right corner, Network View is a graphic representation of the "Suspicious DNS".</p>
+ <ol>
+ <li>As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br></li>
+ <li>Diamonds represents DNS records and circles represents IP addresses communicating to the respective DNS record<br><br></li>
+ <li>A primary mouse click in an IP Address (circle) will bring a diagram within Details frame, providing all the Domain Name records queried by that particular IP Address<br><br></li>
+ <li>A secondary mouse click uses the node information to filter suspicious data.<br><br></li>
+ </ol>
</li>
<li>
- <b>The Details frame</b><br><br>
- Located at the bottom right corner of the Web page. It provides additional information for the selected connection.<br><br>
- Detail View frame has two modes:<br><br>
+ <p class="short-mrg"><strong>The Details frame</strong><br>
+ Located at the bottom right corner of the Web page. It provides additional information for the selected connection.</p>
+ <p class="short-mrg">Detail View frame has two modes:</p>
<ul>
<li>Table details (when you select a record in the Suspicious frame).</li>
- <li>Dendrogram diagram (when you select an IP address in the Network View frame)<br><br></li>
+ <li>Dendrogram diagram (when you select an IP address in the Network View frame)</li>
</ul>
</li>
<li>
- <b>The Notebook frame</b><br>
- <p>
- This frame contains an initialized Jupyter Notebook. The main function is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, therefor [...]
- </p>
- <p>
- <b>The Score button</b><br><br>
- Pressing the 'Score' button will find all exact matches of the selected threat (Client IP or Query) in the dns_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the dns_scores.csv file at the end of the process.<br>
- Selecting values from both the "Client IP" and "Query" lists to score them together, will update every matching threat individually with the same rating value, but not necessarily as a Client_IP-Query pair.<br><br>
- You can score a large set of similar or coincident queries by entering a keyword in the "Quick Scoring" text field and then select a severity value from the radiobutton list. The value entered here will only search for matches on the dns_qry_name name column. "Quick Scoring" text field has precedence over any selection made on the lists.<br>
- </p>
- <p>
- <b>The Save button</b><br><br>
- Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:
+ <p><strong>The Notebook frame</strong><br>This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will [...]
+ <p class="orange-bold" style="margin-bottom:0;">Score button</p>
+ <p class="short-mrg">Pressing the 'Score' button will find all exact matches of the selected threat (Client IP or Query) in the dns_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the dns_scores.csv file at the end of the process.</p>
+ <p class="short-mrg">Selecting values from both the "Client IP" and "Query" lists to score them together, will update every matching threat individually with the same rating value, but not necessarily as a Client_IP-Query pair.</p>
+ <p>You can score a large set of similar or coincident queries by entering a keyword in the "Quick Scoring" text field and then select a severity value from the radiobutton list. The value entered here will only search for matches on the dns_qry_name name column. "Quick Scoring" text field has precedence over any selection made on the lists.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">The Save button</p>
+ <p class="short-mrg">Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:</p>
<ul>
<li>LPATH</li>
<li>MLNODE</li>
@@ -1077,97 +1022,86 @@
</p>
</li>
</ol>
- <b>Input files</b>
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>dns_scores.csv</li>
<li>dns_scores_bu.csv </li>
</ul>
</div>
<div id="dti">
- <h3>DNS Threat Investigation</h3>
- Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.<br>
- Your view should now look like this:<br><br>
- <img src="images/1.1_dns_sc01.jpg"><br><br>
-
- The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.<br><br>
- Select DNS > Threat Investigation from Apache Spot (incubating) Menu.<br><br>
- <img src="images/1.1_dns_ti01.jpg"><br><br>
+ <h4 class="gray">DNS Threat Investigation</h4>
+ <p>Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.</p>
+ <p class="short-mrg">Your view should now look like this:</p>
+ <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
- Threat Investigation Web Page will be opened, loading the embedded Jupyter notebook. A list with all IPs and DNS Names scored as High risk will be presented<br><br>
- <img src="images/1.1_dns_ti02.png"><br><br>
+ <p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.</p>
+ <p class="short-mrg">Select <strong>DNS > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/1.1_dns_ti01.jpg" class="box-shadow" alt="" />
- <b>Expanded Search</b><br><br>
+ <p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all IPs and DNS Names scored as High risk will be presented</p>
+ <img src="images/1.1_dns_ti02.png" class="box-shadow" alt="" />
- Select any value from the list and press the "Search" button. The system will execute a query to the dns table,
- looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following criteria:<br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
+ <p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the dns table, looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following criteria:</p>
- <b>Expanded Search for a particular Domain Name</b><br>
- The query results will provide the different unique IP Addresses list that have queried this particular Domain,
- the list will be sorted by the quantity of connections.<br><br>
- <img src="images/1.1_dns_ti03.jpg" style="width: 50%;"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular Domain Name</p>
+ <p class="short-mrg">The query results will provide the different unique IP Addresses list that have queried this particular Domain, the list will be sorted by the quantity of connections.</p>
+ <p style="text-align:center;"><img src="images/1.1_dns_ti03.jpg" class="box-shadow" alt="" /></p>
- <b>Expanded Search for a particular IP</b><br>
- The expanded search will provide the different unique Domains list that this particular IP queried in one day,
- they will be sorted by the quantity of connections made to each specific Domain Name.<br><br>
- <img src="images/1.1_dns_ti04.jpg" style="width: 50%;"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular IP</p>
+ <p class="short-mrg">The expanded search will provide the different unique Domains list that this particular IP queried in one day, they will be sorted by the quantity of connections made to each specific Domain Name.</p>
+ <p style="text-align: center;"><img src="images/1.1_dns_ti04.jpg" class="box-shadow" alt="" /></p>
- The full output of this query is stored into the threat-dendro-<threat>.csv file, from which the top 'n' results will be extracted and displayed in a table. If an expanded search was previously executed on this IP or Domain, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used, so please monitor t [...]
+ <p class="short-mrg">The full output of this query is stored into the threat-dendro-<threat>.csv file, from which the top 'n' results will be extracted and displayed in a table. If an expanded search was previously executed on this IP or Domain, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used [...]
- <b>Save comments.</b><br>
- In addition, a web form is displayed under the title of 'Threat summary',
- where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.<br><br>
- <img src="images/1.1_dns_ti05.jpg"><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
+ <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
+ <img src="images/1.1_dns_ti05.jpg" class="box-shadow" alt="" />
- Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form.
- This file is used at the Storyboard section to display all the comments entered by the user,
- as well it will serve as a index of the threats analyzed.<br><br>
+ <p class="short-mrg">Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form. This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as a index of the threats analyzed.</p>
- <b>Continue to the Storyboard.</b><br>
- Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.<br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Continue to the Storyboard.</p>
+ <p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
- <b>Input files</b><br>
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>ipython/dns/user/<date>/dns_scores.css</li>
</ul>
- <b>Output files</b>
+ <p class="orange-bold" style="margin-bottom:0;">Output files</p>
<ul>
<li>ipython/dns/user/<date>/threats.csv</li>
<li>ipython/dns/user/<date>/threat-dendro-<threat>.csv</li>
</ul>
- <b>HDFS tables consumed: </b> dns
+ <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed: </p>
+ <p>dns</p>
</div>
<div id="dsb">
- <h3>DNS Storyboard</h3>
- <b>Walk-through</b><br><br>
+ <h4 class="gray">DNS Storyboard</h4>
+ <p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
<ol>
<li>
- Select the option <b>DNS > Storyboard</b> from Apache Spot (incubating) Menu.<br><br>
- <img src="images/dns_sb_tit1.jpg"><br><br>
+ <p>Select the option <strong>DNS > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/dns_sb_tit1.jpg" class="box-shadow" alt="" />
</li>
<li>
- Your view should look something like this,
- depending on how many threats you have analyzed and commented on the Threat Analysis for that day.
- You can select a different date from the calendar.<br><br>
- <img src="images/1.1_dns_sb01.jpg"><br><br>
+ <p class="short-mrg">Your view should look something like this, pending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
+ <img src="images/1.1_dns_sb01.jpg" class="box-shadow" alt="" />
</li>
</ol>
- <p>
- <b>Executive Threat Briefing</b><br>
- <b>Data source file:</b> threats.csv<br>
- Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook.
- You can click on any title and view the additional comments at the bottom area of the panel.<br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
+ <p class="short-mrg"><strong>Data source file:</strong> threats.csv<br>
+ Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom area of the panel.</p>
- <b>Incident progression</b>
- <b>Data source file:</b> threat-dendro-<threat>.csv<br>
- Incident progression frame is located on the right side of the Web page.<br><br>
- <img src="images/1.1_dns_sb02.jpg" style="width: 50%;"><br><br>
+ <p class="short-mrg"><strong>Incident progression Data source file:</strong> threat-dendro-<threat>.csv<br>Incident progression frame is located on the right side of the Web page.</p>
+
+ <img src="images/1.1_dns_sb02.jpg" class="box-shadow" alt="" />
- This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.<br><br>
+ <p class="short-mrg">This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
- <b>Input files</b>
+ <p class="orange-bold" style="margin-bottom: 0;">Input files</p>
<ul>
<li>threats.csv</li>
<li>threat-dendro-<threat>.csv</li>
@@ -1176,21 +1110,19 @@
</div>
</div>
<div id="uproxy">
- <h2>Proxy</h2>
+ <h3 style="margin-bottom: 0;">Proxy</h3>
<div id="psc">
- <h3>Suspicious Proxy</h3>
- <b>Walk-through</b>
+ <h4 class="gray">Suspicious Proxy</h4>
+ <strong>Walk-through</strong>
<ol>
<li>
- <b>Open the analyst view for Suspicious Proxy:</b> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>.
- Select the date that you want to review (defaults to current date). <br>
- Your screen should now look like this:<br><br>
- <img src="images/1.1_proxy_sc01.jpg"><br><br>
+ <p class="short-mrg"><strong>Open the analyst view for Suspicious Proxy:</strong> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>. Select the date that you want to review (defaults to current date).</p>
+ <p class="short-mrg">Your screen should now look like this:</p>
+ <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" /><br><br>
</li>
<li>
- <b>The Suspicious frame</b><br><br>
- Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.<br><br>
+ <p class="short-mrg"><strong>The Suspicious frame</strong><br>Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.</p>
<ol>
<li>
@@ -1211,10 +1143,10 @@
</ol>
</li>
<li>
- <b>The Network View frame</b><br><br>
- Located at the top right corner, Network View is a hierarchical force graph used to represent the "Suspicious Proxy" connections.<br><br>
+ <p class="short-mrg"><strong>The Network View frame</strong><br>
+ Located at the top right corner, Network View is a hierarchical force graph used to represent the "Suspicious Proxy" connections.</p>
- <b>Network View Force Graph Order Hierarchy</b><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Network View Force Graph Order Hierarchy</strong></p>
<ul>
<li>Root Proxy Node</li>
<li>Proxy Request Method</li>
@@ -1222,114 +1154,104 @@
<li>Proxy Path</li>
<li>Client IP Address</li>
</ul><br>
- <b>Network View Functionality</b>
+ <p class="orange-bold" style="margin-bottom:0;">Network View Functionality</p>
<ol>
<li>
- As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br>
- <img src="images/1.1_proxy_sc02.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">As soon as you move your mouse over a node, a dialog shows up providing additional information.</p>
+ <img src="images/1.1_proxy_sc02.jpg" class="box-shadow" alt="" />
</li>
<li>
- Graph can be zoomed in/out and can be moved in the frame<br><br>
- <img src="images/1.1_proxy_sc03.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">Graph can be zoomed in/out and can be moved in the frame</p>
+ <img src="images/1.1_proxy_sc03.jpg" class="box-shadow" alt="" />
</li>
<li>
- By double-clicking in the Root Proxy Node the graph can be fully expanded/collapsed<br><br>
- <img src="images/1.1_proxy_sc04.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">By double-clicking in the Root Proxy Node the graph can be fully expanded/collapsed</p>
+ <img src="images/1.1_proxy_sc04.jpg" class="box-shadow" alt="" />
</li>
<li>
- By double-clicking a node, the node can be expanded/collapsed one level<br><br>
- <img src="images/1.1_proxy_sc05.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">By double-clicking a node, the node can be expanded/collapsed one level</p>
+ <img src="images/1.1_proxy_sc05.jpg" class="box-shadow" alt="" />
</li>
<li>
- The path in yellow represents the Suspicious record selected in the suspicious frame<br><br>
- <img src="images/1.1_proxy_sc06.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">The path in yellow represents the Suspicious record selected in the suspicious frame</p>
+ <img src="images/1.1_proxy_sc06.jpg" class="box-shadow" alt="" />
</li>
<li>
- Records will be highlighted with different colors depending upon the Risk Reputation provided by the Reputation Service<br><br>
- <img src="images/1.1_proxy_sc07.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">Records will be highlighted with different colors depending upon the Risk Reputation provided by the Reputation Service</p>
+ <img src="images/1.1_proxy_sc07.jpg" class="box-shadow" alt="" />
</li>
<li>
- A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames <br><br>
- <img src="images/1.1_proxy_sc08.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames </p>
+ <img src="images/1.1_proxy_sc08.jpg" class="box-shadow" alt="" />
</li>
</ol>
</li>
<li>
- <b>The Details frame</b><br><br>
- Located at the bottom right corner of the Web page. It provides additional information for the selected connection in the Suspicious frame.
- It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type, Proxy Server IP, Bytes.<br><br>
- <img src="images/1.1_proxy_sc09.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg" style="margin-bottom:0;"><strong>The Details frame</strong></p>
+ <p class="short-mrg">Located at the bottom right corner of the Web page. It provides additional information for the selected connection in the Suspicious frame.
+ It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type, Proxy Server IP, Bytes.</p>
+ <img src="images/1.1_proxy_sc09.jpg" class="box-shadow" alt="" />
</li>
<li>
- <b>The Notebook frame</b><br><br>
- This frame contains an initialized Jupyter Notebook. The main function is to allow the Analyst to score Proxy records with different values. In order to assign a risk to a specific connection, select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.<br><br>
- <img src="images/1.1_proxy_sc10.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg"><strong>The Notebook frame</strong><br>
+ This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score Proxy records with different values. In order to assign a risk to a specific connection, select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.</p>
+ <img src="images/1.1_proxy_sc10.jpg" class="box-shadow" alt="" />
</li>
</ol>
- <b>The Score button</b><br><br>
- Pressing the 'Score' button will find all exact matches of the selected threat (Proxy Record) in the proxy_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the proxy_scores.csv file at the end of the process.<br><br>
+ <p class="orange-bold" style="margin-bottom: 0;">The Score button</p>
+ <p>Pressing the 'Score' button will find all exact matches of the selected threat (Proxy Record) in the proxy_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the proxy_scores.csv file at the end of the process.</p>
- <b>The Save button</b><br><br>
- Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:
+ <p class="orange-bold" style="margin-bottom:0;">The Save button</p>
+ <p class="short-mrg">Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:</p>
<ul>
<li>LPATH</li>
<li>MLNODE</li>
<li>LUSER</li>
</ul>
- For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.<br><br>
+ <p>For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
- <b>Input files</b>
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>proxy_scores.csv </li>
<li>proxy_scores_bu.csv</li>
</ul>
</div>
<div id="pti">
- <h3>Proxy Threat Investigation</h3>
- <b>Walk-through</b><br><br>
- Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review. <br>
- Your view should now look like this:<br><br>
- <img src="images/1.1_proxy_sc01.jpg"><br><br>
+ <h4 class="gray">Proxy Threat Investigation</h4>
+ <p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
+ <p class="short-mrg">Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review.</p>
+ <p class="short-mrg">Your view should now look like this:</p>
+ <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" />
- The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.
- Select <b>Proxy > Threat Investigation</b> from Apache Spot (incubating) Menu.<br><br>
- <img src="images/1.1_proxy_ti01.jpg"><br><br>
+ <p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.</p>
+ <p class="short-mrg">Select <strong>Proxy > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/1.1_proxy_ti01.jpg" class="box-shadow" alt="" /><br><br>
- Threat Investigation Web Page will be opened, loading the embedded Jupyter notebook. A list with all Proxy Records scored as High risk will be presented<br><br>
- <img src="images/1.1_proxy_ti02.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all Proxy Records scored as High risk will be presented</p>
+ <img src="images/1.1_proxy_ti02.jpg" class="box-shadow" alt="" /><br><br>
- <b>Expanded Search</b><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
- Select any value from the list and press the "Search" button. The system will execute a query to the proxy table,
- looking into the raw data initially collected to find additional activity for the selected Proxy Record.
- Results will be extracted and displayed in a table. If an expanded search was previously executed on this Proxy Record,
- the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table.
- Query execution time is long and will vary depending on whether Hive or Impala is being used, so please monitor the notebooks status icon for completion.
- The quantity of results displayed on screen can be set by modifying the top_results variable,
- additional information on how to modify this variable can be found <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/proxy/ipynb_templates/ThreatInvestigation.md"> here</a><br><br>
- <img src="images/1.1_proxy_ti03.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the proxy table, looking into the raw data initially collected to find additional activity for the selected Proxy Record. Results will be extracted and displayed in a table. If an expanded search was previously executed on this Proxy Record, the system will extract the results from the preexisting file to reduce the execution time by avoiding anothe [...]
+ <img src="images/1.1_proxy_ti03.jpg" class="box-shadow" alt="" />
+ <p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
+ <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.</p>
+ <img src="images/1.1_proxy_ti04.jpg" class="box-shadow" alt="" />
- <b>Save comments.</b><br><br>
- In addition, a web form is displayed under the title of 'Threat summary',
- where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.<br><br>
- <img src="images/1.1_proxy_ti04.jpg" style="width: 60%;"><br><br>
+ <p class="short-mrg">Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form. This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as an index of the threats analyzed.</p>
+ <p class="orange-bold" style="margin-bottom: 0;">Continue to the Storyboard.</p>
+ <p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
- Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form.
- This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as an index of the threats analyzed.<br><br>
-
- <b>Continue to the Storyboard.</b><br>
- Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.<br><br>
-
- <b>Input files</b>
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>proxy_scores.tsv</li>
</ul>
- <b>Output files</b>
+ <p class="orange-bold" style="margin-bottom:0;">Output files</p>
<ul>
<li>threats.csv</li>
<li>es-{id}.csv</li>
@@ -1337,53 +1259,47 @@
<li>timeline-{id}.tsv</li>
</ul>
- <b>HDFS tables consumed:</b> proxy
+ <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
+ <p>proxy</p>
</div>
<div id="psb">
- <h3>Proxy Storyboard</h3>
+ <h4 class="gray">Proxy Storyboard</h4>
<ol>
<li>
- Select the option <b>Proxy > Storyboard</b> from Apache Spot (incubating) Menu.<br><br>
- <img src="images/1.1_proxy_sb01.jpg"><br><br>
+ Select the option <strong>Proxy > Storyboard</strong> from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/1.1_proxy_sb01.jpg" class="box-shadow" alt="" />
</li>
<li>
- Your view should look something like this,
- depending on how many threats you have analyzed and commented on the Threat Analysis for that day.
- You can select a different date from the calendar.<br><br>
- <img src="images/1.1_proxy_sb02.jpg"><br><br>
+ <p class="short-mrg">Your view should look something like this,
+ depending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
+ <img src="images/1.1_proxy_sb02.jpg" class="box-shadow" alt="" />
</li>
</ol>
- <b>Executive Threat Briefing</b><br><br>
- <b>Data source file:</b> threats.csv<br>
- Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook.
- You can click on any title and view the additional comments at the bottom area of the panel.<br><br>
- <img src="images/1.1_proxy_sb03.jpg" style="width: 50%;"><br><br>
-
- <b>Incident progression</b><br><br>
- <b>Data source file:</b> incident-progression-{id}.json<br>
- Incident progression frame is located on the right side of the Web page.
- Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.
- It presents the following fields:
+ <p class="orange-bold">Executive Threat Briefing</p>
+ <p class="short-mrg"><strong>Data source file:</strong> threats.csv<br>
+ Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom area of the panel.</p>
+ <p style="text-align: center;"><img src="images/1.1_proxy_sb03.jpg" class="box-shadow" alt="" /></p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Incident progression</p>
+ <p class="short-mrg"><strong>Data source file:</strong> incident-progression-{id}.json<br>Incident progression frame is located on the right side of the Web page. Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat. It presents the following fields:</p>
<ul>
- <li><b>Referer</b> - URLs that refers to the Suspicious Proxy Record</li>
- <li><b>IP</b> - All ip addresses connecting to the Suspicious Proxy Record</li>
- <li><b>Method</b> - Proxy methods used to communicate in between the IP addresses and the Proxy Record</li>
- <li><b>ContentType</b> - HTTP MIME Types</li>
- <li><b>Threat</b> - Represents the Suspicious Proxy Record</li>
- <li><b>Referred</b> - URLs that the Suspicious Proxy Record referred to</li><br>
- <img src="images/1.1_proxy_sb04.jpg" style="width: 60%;"><br><br>
-
- If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.<br><br>
- <img src="images/1.1_proxy_sb06.jpg" style="width: 60%;"><br><br>
-
- <b>Timeline</b><br>
- <b>Data source file:</b> timeline-{id}.tsv<br>
- Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll.
- The number next to the IP Address represents the quantity of connections made from that particular IP to the Proxy Record in the displayed time.<br><br>
- <img src="images/1.1_proxy_sb05.jpg" style="width: 60%;"><br><br>
-
- <b>Input files</b><br><br>
+ <li><strong>Referer</strong> - URLs that refers to the Suspicious Proxy Record</li>
+ <li><strong>IP</strong> - All ip addresses connecting to the Suspicious Proxy Record</li>
+ <li><strong>Method</strong> - Proxy methods used to communicate in between the IP addresses and the Proxy Record</li>
+ <li><strong>ContentType</strong> - HTTP MIME Types</li>
+ <li><strong>Threat</strong> - Represents the Suspicious Proxy Record</li>
+ <li><strong>Referred</strong> - URLs that the Suspicious Proxy Record referred to</li>
+ <img src="images/1.1_proxy_sb04.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.</p>
+ <img src="images/1.1_proxy_sb06.jpg" class="box-shadow" alt="" /><br><br>
+
+ <p class="orange-bold" style="margin-bottom:0;">Timeline</p>
+ <p class="short-mrg"><strong>Data source file:</strong> timeline-{id}.tsv<br>Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll. The number next to the IP Address represents the quantity of [...]
+ <img src="images/1.1_proxy_sb05.jpg" class="box-shadow" alt="" /><br><br>
+
+ <p class="orange-bold" style="margin-bottom:0;">Input files</p>
<ul>
<li>threats.csv</li>
<li>incident-progression-{id}.json</li>
diff --git a/index.html b/index.html
index 8cb0674..cc9d552 100755
--- a/index.html
+++ b/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -58,9 +58,9 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
<header class="header">
<div id="inner-header" class="wrap cf">
@@ -116,7 +116,7 @@
</div>
</div>
</div>
-
+
<div id="at-a-glance">
<div class="wrap cf">
<h1>Apache Spot at a Glance</h1>
@@ -266,7 +266,7 @@
</p>
</div>
</div>
-
+
<div id="open-data-models">
<div class="wrap cf">
<h1 class="center">Apache Spot Open Data Models (ODM)</h1>
@@ -292,9 +292,9 @@
<p class="btn-margin center">
Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
</p>
-
+
<p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
-
+
<div class="community">
<img src="library/images/community/endgame.png" alt="Endgame" />
<img src="library/images/community/intel.png" alt="Intel" />
@@ -307,7 +307,7 @@
<img src="library/images/community/ebay.png" alt="Ebay" />
<img src="library/images/community/semantix.png" alt="Ebay" />
<img src="library/images/community/rich-it.png" alt="Ebay" />
-
+
</div>
</div>
@@ -373,11 +373,11 @@
</div>
</div>
</div>
-
+
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
@@ -415,4 +415,4 @@
</body>
-</html>
+</html>
\ No newline at end of file
diff --git a/library/images/advantages-1.png b/library/images/advantages-1.png
index cf6e381..8d8f531 100755
Binary files a/library/images/advantages-1.png and b/library/images/advantages-1.png differ
diff --git a/library/images/advantages-1.png b/library/images/advantages-1_old.png
similarity index 100%
copy from library/images/advantages-1.png
copy to library/images/advantages-1_old.png
[incubator-spot] 34/45: Enabling download links for Apache Release,
after approved by Incubator PMC
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit d1f45846b393a7736e4ccfdf7913b28ea8773118
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Thu Aug 24 19:38:46 2017 -0500
Enabling download links for Apache Release, after approved by Incubator PMC
---
2016/03/index.html | 34 +-
2016/08/index.html | 33 +-
2016/09/index.html | 32 +-
2016/10/index.html | 30 +-
2017/03/index.html | 36 +-
blog/apache-spot-3-most-asked-questions/index.html | 30 +-
.../index.html | 34 +-
.../index.html | 46 +-
.../index.html | 30 +-
blog/index.html | 22 +-
.../jupyter-notebooks-for-data-analysis/index.html | 38 +-
.../index.html | 30 +-
category/cybersecurity/index.html | 32 +-
category/data-science/index.html | 30 +-
category/ipython-notebooks/index.html | 35 +-
category/security-analytics/index.html | 30 +-
category/threat-analysis-tools/index.html | 30 +-
category/uncategorized/index.html | 36 +-
community/committers/index.html | 13 +-
community/contribute/index.html | 5 +-
community/index.html | 5 +-
doc/css/meanmenu.css | 18 +
doc/css/style.css | 42 +-
doc/images/1.1_sc10.png | Bin 0 -> 64761 bytes
doc/images/1.1_sc2.png | Bin 0 -> 167136 bytes
doc/images/1.1_sc3.png | Bin 0 -> 300114 bytes
doc/images/1.1_sc4.png | Bin 0 -> 116496 bytes
doc/images/1.1_sc5.png | Bin 0 -> 125685 bytes
doc/images/1.1_sc6.png | Bin 0 -> 81388 bytes
doc/images/1.1_sc7.png | Bin 0 -> 86382 bytes
doc/images/1.1_sc8.png | Bin 0 -> 55375 bytes
doc/images/1.1_sc9.png | Bin 0 -> 55798 bytes
doc/images/1.1_ti01.png | Bin 0 -> 180375 bytes
doc/images/1.1_ti02.png | Bin 0 -> 15195 bytes
doc/images/1.1_ti03.png | Bin 0 -> 38882 bytes
doc/images/1.1sc1.png | Bin 0 -> 228053 bytes
doc/images/1.1sc_11.png | Bin 0 -> 228053 bytes
doc/images/netflow.png | Bin 0 -> 28773 bytes
doc/images/plugins-1.png | Bin 0 -> 175643 bytes
doc/images/plugins-2.png | Bin 0 -> 139187 bytes
doc/images/plugins-3.png | Bin 0 -> 61327 bytes
doc/images/plugins-4.png | Bin 0 -> 55778 bytes
doc/images/plugins-5.png | Bin 0 -> 40982 bytes
doc/images/plugins-6.png | Bin 0 -> 102311 bytes
doc/images/plugins-7.png | Bin 0 -> 114973 bytes
doc/images/sb_tit1.png | Bin 0 -> 24752 bytes
doc/index.html | 2684 ++++++++++----------
{get-started => download}/index.html | 144 +-
get-started/architecture/index.html | 7 +-
get-started/demo/index.html | 7 +-
get-started/environment/index.html | 11 +-
get-started/index.html | 7 +-
get-started/supporting-apache/index.html | 7 +-
index.html | 5 +-
library/css/meanmenu.css | 18 +-
library/css/style.css | 71 +-
library/images/architecture.png | Bin 0 -> 228333 bytes
library/images/bug-1.png | Bin 0 -> 49345 bytes
library/images/bug-2.png | Bin 0 -> 139376 bytes
library/images/bug-3.png | Bin 0 -> 60246 bytes
library/images/bug-4.png | Bin 0 -> 89285 bytes
library/images/bug-5.png | Bin 0 -> 21122 bytes
library/images/bug-6.png | Bin 0 -> 104081 bytes
library/images/bug-7.png | Bin 0 -> 42537 bytes
library/images/details.png | Bin 92267 -> 126257 bytes
library/images/{details.png => details_old.png} | Bin
library/images/download-logo.png | Bin 0 -> 75862 bytes
library/images/download.png | Bin 0 -> 6735 bytes
library/images/network.png | Bin 62056 -> 81366 bytes
library/images/{network.png => network_old.png} | Bin
library/images/notebook.png | Bin 54507 -> 64008 bytes
library/images/{notebook.png => notebook_old.png} | Bin
library/images/service-layout-sm.png | Bin 0 -> 89815 bytes
library/images/service-layout.png | Bin 0 -> 157171 bytes
library/images/susp-con-1.png | Bin 0 -> 2655 bytes
library/images/susp-con-2.png | Bin 0 -> 3060 bytes
library/images/susp-con-3.png | Bin 0 -> 11562 bytes
library/images/suspicious.png | Bin 80577 -> 58408 bytes
.../images/{suspicious.png => suspicious_old.png} | Bin
project-components/ingestion/index.html | 5 +-
project-components/machine-learning/index.html | 5 +-
project-components/open-data-models/index.html | 7 +-
.../suspicious-connects-analysis/index.html | 5 +-
project-components/visualization/index.html | 5 +-
tag/github/index.html | 32 +-
tag/open-network-insight/index.html | 34 +-
tag/open-source/index.html | 32 +-
87 files changed, 2081 insertions(+), 1676 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index b733b5c..8785af4 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,7 +166,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,13 +210,13 @@
</li>
</ul>
</div>
-
+
</div>
</div>
</div>
-
+
<footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
@@ -224,4 +236,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/2016/08/index.html b/2016/08/index.html
index 5df564b..5973a38 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,30 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +110,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -182,7 +197,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -226,7 +241,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/2016/09/index.html b/2016/09/index.html
index f779703..54fdca6 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -153,7 +165,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -197,7 +209,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
@@ -221,4 +233,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/2016/10/index.html b/2016/10/index.html
index 987a412..8d12ad5 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,7 +166,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/2017/03/index.html b/2017/03/index.html
index 48afb8c..d953f1e 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
- </li>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -152,7 +164,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -196,13 +208,13 @@
</li>
</ul>
</div>
-
+
</div>
</div>
</div>
-
+
<footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
@@ -222,4 +234,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index 6620b79..32246db 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -188,7 +200,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -232,7 +244,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index baa4974..747e1c0 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -193,7 +205,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -237,13 +249,13 @@
</li>
</ul>
</div>
-
+
</div>
</div>
</div>
-
+
<footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
@@ -263,4 +275,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index ed02a39..24e2eff 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -142,22 +154,22 @@
<p>Spot can directly collect netflow data, DNS data and/or proxy data. This data can be collected also from a SIEM or from a common logging server. Additional data types can be collected using Open Data Model. Any number of data sources can be analyzed using Spot. Because most of these data sources represent a large volume of data, most organizations start with the data source that represents the area of highest risk.</p>
<h3>Data Storage</h3>
<p>Using nfdump for netflow data, TShark for DNS data and a parser for proxy data, the Spot collectors process the information that is sent. This data is ingested into Spot’s HDFS. Once Spot has received 3-4 hours of data, the analysis to detect suspicious connections using machine learning algorithms is performed.</p>
-
+
<h3>Data Analysis and Machine Learning</h3>
<p>The machine learning component of Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable and most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS and proxy records.</p>
-
+
<p>Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents.</p>
-
+
<p>Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
-
+
<blockquote>LDA is a generative probabilistic model used for discrete data such as text corpora. LDA is a three- level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common n [...]
-
+
<h3>Analytics</h3>
<p>Context is then added to the results generated by machine learning algorithms. The results are enriched, with relocalization and threat reputation for each connection, accelerating the detection of compromise indicators.</p>
-
+
<h3>Visualization</h3>
<p>The top 300 suspicious results are sent to the Spot GUI to visualize. With the Spot GUI, the top suspicious network activity can be reviewed and the user can engage with data right in the browser. The Spot GUI can also be used to execute advanced search or create a storyboard of the security threats. It also takes advantage of latest Web technologies to provide Web Components (ReactJS+Flux), amazing user experience (Bootstrap + D3), data manipulation (IPython notebooks) and ea [...]
-
+
<h3>New in March 10, 2017 Release</h3>
<ul>
<li>Use GraphQL to query data from HDFS Parquet files instead of Local File System CSVs files</li>
@@ -166,7 +178,7 @@
<li>Modify ML component to read feedback direct from HDFS</li>
<li>Database schema change to store spot data</li>
</ul>
-
+
<h3>Coming in Future Releases</h3>
<p>In the next releases, Apache Spot will share IoC (suspicious results ranked) with other security tools. Suspicious results scored as a critical can be shared using McAfee Open DXL with the Open Security Controller and/or McAfee ePO to adjust or tune your security policies in real time.</p>
<p class="small">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. “Latent Dirichlet Allocation.” Journal of Machine Learning Research 3, no. Jan (2003): 993-1022.</p>
@@ -182,7 +194,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -226,7 +238,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index ed63c00..0b07777 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -175,7 +187,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -219,7 +231,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/blog/index.html b/blog/index.html
index ff8887c..3ad2400 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -67,14 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../get-started">Get Started</a></li>
+ <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../get-started/environment">Environment</a></li>
+ <li><a href="../get-started/architecture">Architecture</a></li>
+ <li><a href="../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../../community">Community</a>
+ <a href="../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../community" class="mail">Mailing Lists</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../project-components/ingestion">Ingestion</a></li>
<li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index 4ed253b..5a0da00 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -211,19 +223,19 @@
We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.
</p>
</section>
-
+
<footer class="article-footer">
-
+
filed under: <a href="../../category/data-science/" rel="category tag">Data Science</a>, <a href="../../category/ipython-notebooks/" rel="category tag">Ipython Notebooks</a>, <a href="../../category/threat-analysis-tools/" rel="category tag">Threat Analysis Tools</a>
-
- </footer>
+
+ </footer>
</article>
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -267,7 +279,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 3fbdc20..ae21cd7 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -164,7 +176,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -208,7 +220,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index eddbde7..959b58b 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -152,9 +164,9 @@
</article>
</main>
-
+
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 644d6b7..2dce6fe 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,7 +166,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 5af9f52..f774b92 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,13 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -151,9 +164,9 @@
</article>
</main>
-
+
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -197,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
@@ -222,4 +235,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index 526ef25..9b3e098 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -153,7 +165,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -197,7 +209,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index e30026a..1d2a140 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,7 +166,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index adaa02a..2cf4697 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -121,7 +133,7 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
<h1 class="page-title">Category: Uncategorized</h1>
-
+
<article class="cf post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
<header class="entry-header article-header">
@@ -146,7 +158,7 @@
</footer>
- </article>
+ </article>
<article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
@@ -207,7 +219,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -251,7 +263,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
@@ -276,4 +288,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/community/committers/index.html b/community/committers/index.html
index 17fad87..8e80331 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
@@ -281,7 +284,7 @@
<div class="divTableRow">
<div class="divTableCell">raypanduro</div>
<div class="divTableCell">Raymundo Panduro</div>
- <div class="divTableCell"></div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
@@ -308,6 +311,12 @@
<div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
+ <div class="divTableRow">
+ <div class="divTableCell">vsingh</div>
+ <div class="divTableCell">Vartika Singh</div>
+ <div class="divTableCell">Cloudera</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
</div>
</div>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index 3015e3a..fb1d454 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
diff --git a/community/index.html b/community/index.html
index 42eccc8..a9ead03 100755
--- a/community/index.html
+++ b/community/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../community">Community</a>
diff --git a/doc/css/meanmenu.css b/doc/css/meanmenu.css
index 390797e..05281b4 100755
--- a/doc/css/meanmenu.css
+++ b/doc/css/meanmenu.css
@@ -214,6 +214,24 @@ a.meanmenu-reveal {
background:rgba(255,255,255,.1) url('../images/twitter-icon.png') no-repeat;
}
+
+@media only screen and (max-width:1030px) {
+ .under-dev {
+ background:#aea698;
+ color:#fff;
+ font-weight:700;
+ text-transform: uppercase;
+ padding:10px;
+ width:100%;
+ border-bottom:1px solid #ccc;
+ line-height: 1.4em;
+ font-size:11pt;
+ letter-spacing: 1px;
+ text-align: center;
+ }
+}
+
+
@media only screen and (min-width:768px) {
.mean-container .mean-nav .slack {
background-position:left 7% center !important;
diff --git a/doc/css/style.css b/doc/css/style.css
index ca843b0..7c8ad43 100755
--- a/doc/css/style.css
+++ b/doc/css/style.css
@@ -279,8 +279,8 @@ GRID STYLES
.d-1of10 { float: left; padding-right: 0.75em; width: 10%; }
.d-1of11 { float: left; padding-right: 0.75em; width: 9.09090909091%; }
.d-1of12 { float: left; padding-right: 0.75em; width: 8.33%; } }
-
-
+
+
/*********************
GENERAL STYLES
*********************/
@@ -334,7 +334,7 @@ LAYOUT
-webkit-box-shadow: 4px 4px 10px 0px rgba(50, 50, 50, 0.35);
-moz-box-shadow: 4px 4px 10px 0px rgba(50, 50, 50, 0.35);
box-shadow: 4px 4px 10px 0px rgba(50, 50, 50, 0.35);
-margin-bottom:25px;
+margin-bottom:25px;
}
/*********************
PUSH MENU
@@ -539,21 +539,21 @@ table.configuration.config2 tr td:nth-child(2) {font-size:9.5pt !important;}
@media only screen and (min-width:768px) {
.wrap { width: 760px; }
#masthead {min-height:300px;}
- #masthead .wrap {min-height:250px;}
+ #masthead .wrap {min-height:250px;}
#masthead .wrap { text-align: left; position:relative;min-height:550px;}
.contribute {position:absolute;bottom:0;right:0;max-width:500px;color:#fff;text-align:center;}
#masthead h1 { text-align: left; margin: 0; }
#masthead p { text-align: left; }
.page #masthead .wrap {min-height:250px;}
- .page #masthead h1 {text-align:center;margin:0 auto;}
+ .page #masthead h1 {text-align:center;margin:0 auto;}
}
@media only screen and (min-width:1030px) {
.desktop {display:block;}
.mobile {display:none;}
.wrap { width: 1040px; }
- #logo { float: left; text-align: left; }
- .cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
+ #logo { float: left; text-align: left; }
+ .cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
.nav li a { padding: .75em 1.6em; }
.nav li:last-child a {padding-right:0;}
.nav li ul.sub-menu.com-sm li a {
@@ -601,14 +601,16 @@ li.divider {
.nav li ul.sub-menu.com-sm li a {
padding-left:15px;
}
- #masthead .wrap {min-height:360px;display: flex; justify-content: flex-end; align-items: center; align-content: flex-end;text-align:right;}
+ #masthead .wrap {min-height:360px;display: flex; justify-content: flex-end; align-items: center; align-content: flex-end;text-align:right;}
.cbp-spmenu {position:fixed;}
- /********************* NAVIGATION STYLES ********************/
+
+
+ /********************* NAVIGATION STYLES ********************/
.nav { border: 0; float: right; margin-top: 35px; }
.nav ul { background: #e8e5e0; margin-top: 0; }
- .nav li { float: left; position: relative; }
- .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.5em;}
+ .nav li { float: left; position: relative;margin-bottom:0; }
+ .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.2em;line-height: 1.4em;}
.nav li a:hover, .nav li a:focus { color: #c97644; }
.nav li.active > a {color:#c97644;}
.nav li ul.sub-menu, .nav li ul.children { margin-top: 0; position: absolute; visibility: hidden;opacity:0; z-index: 8999;padding-left:0; -webkit-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-moz-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-ms-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s; -o-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-i [...]
@@ -617,7 +619,21 @@ li.divider {
.nav li ul.sub-menu li a:hover, .nav li ul.children li a:hover {color:#c97644;}
.nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
.nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
- .nav li:hover > ul { top: auto; visibility: visible; opacity:1;-moz-transform: translateY(0%);-webkit-transform: translateY(0%); -o-transform: translateY(0%);-ms-transform: translateY(0%); transform: translateY(0%); -webkit-transition-delay: 0s, 0s, 0.3s;-moz-transition-delay: 0s, 0s, 0.3s;-o-transition-delay: 0s, 0s, 0.3s;transition-delay: 0s, 0s, 0.3s;}
+ .nav li:hover > ul { top: auto; visibility: visible; opacity:1;-moz-transform: translateY(0%);-webkit-transform: translateY(0%); -o-transform: translateY(0%);-ms-transform: translateY(0%); transform: translateY(0%); -webkit-transition-delay: 0s, 0s, 0.3s;-moz-transition-delay: 0s, 0s, 0.3s;-o-transition-delay: 0s, 0s, 0.3s;transition-delay: 0s, 0s, 0.3s;}
+}
+
+.under-dev {
+ background:#aea698;
+ color:#fff;
+ font-weight:700;
+ text-transform: uppercase;
+ padding:10px;
+ width:100%;
+ border-bottom:1px solid #ccc;
+ line-height: 1.4em;
+ font-size:10.2pt;
+ letter-spacing: 1px;
+ text-align: center;
}
@media only screen and (min-width:1240px) {
@@ -633,4 +649,4 @@ li.divider {
}
@media only screen and (min-width:1920px) {
#masthead{min-height:400px;background-position:top -334px center;}
-}
\ No newline at end of file
+}
diff --git a/doc/images/1.1_sc10.png b/doc/images/1.1_sc10.png
new file mode 100755
index 0000000..bcb06e2
Binary files /dev/null and b/doc/images/1.1_sc10.png differ
diff --git a/doc/images/1.1_sc2.png b/doc/images/1.1_sc2.png
new file mode 100755
index 0000000..6e0ebc1
Binary files /dev/null and b/doc/images/1.1_sc2.png differ
diff --git a/doc/images/1.1_sc3.png b/doc/images/1.1_sc3.png
new file mode 100755
index 0000000..3eb92ee
Binary files /dev/null and b/doc/images/1.1_sc3.png differ
diff --git a/doc/images/1.1_sc4.png b/doc/images/1.1_sc4.png
new file mode 100755
index 0000000..845a351
Binary files /dev/null and b/doc/images/1.1_sc4.png differ
diff --git a/doc/images/1.1_sc5.png b/doc/images/1.1_sc5.png
new file mode 100755
index 0000000..aff4c56
Binary files /dev/null and b/doc/images/1.1_sc5.png differ
diff --git a/doc/images/1.1_sc6.png b/doc/images/1.1_sc6.png
new file mode 100755
index 0000000..cfc2aaf
Binary files /dev/null and b/doc/images/1.1_sc6.png differ
diff --git a/doc/images/1.1_sc7.png b/doc/images/1.1_sc7.png
new file mode 100755
index 0000000..ff94fc8
Binary files /dev/null and b/doc/images/1.1_sc7.png differ
diff --git a/doc/images/1.1_sc8.png b/doc/images/1.1_sc8.png
new file mode 100755
index 0000000..f24b8ae
Binary files /dev/null and b/doc/images/1.1_sc8.png differ
diff --git a/doc/images/1.1_sc9.png b/doc/images/1.1_sc9.png
new file mode 100755
index 0000000..45a20dd
Binary files /dev/null and b/doc/images/1.1_sc9.png differ
diff --git a/doc/images/1.1_ti01.png b/doc/images/1.1_ti01.png
new file mode 100755
index 0000000..fa15cf6
Binary files /dev/null and b/doc/images/1.1_ti01.png differ
diff --git a/doc/images/1.1_ti02.png b/doc/images/1.1_ti02.png
new file mode 100755
index 0000000..9e92d9b
Binary files /dev/null and b/doc/images/1.1_ti02.png differ
diff --git a/doc/images/1.1_ti03.png b/doc/images/1.1_ti03.png
new file mode 100755
index 0000000..32747c2
Binary files /dev/null and b/doc/images/1.1_ti03.png differ
diff --git a/doc/images/1.1sc1.png b/doc/images/1.1sc1.png
new file mode 100755
index 0000000..8563c71
Binary files /dev/null and b/doc/images/1.1sc1.png differ
diff --git a/doc/images/1.1sc_11.png b/doc/images/1.1sc_11.png
new file mode 100755
index 0000000..8563c71
Binary files /dev/null and b/doc/images/1.1sc_11.png differ
diff --git a/doc/images/netflow.png b/doc/images/netflow.png
new file mode 100755
index 0000000..4b56874
Binary files /dev/null and b/doc/images/netflow.png differ
diff --git a/doc/images/plugins-1.png b/doc/images/plugins-1.png
new file mode 100755
index 0000000..b965b12
Binary files /dev/null and b/doc/images/plugins-1.png differ
diff --git a/doc/images/plugins-2.png b/doc/images/plugins-2.png
new file mode 100755
index 0000000..88636d7
Binary files /dev/null and b/doc/images/plugins-2.png differ
diff --git a/doc/images/plugins-3.png b/doc/images/plugins-3.png
new file mode 100755
index 0000000..3fe8a24
Binary files /dev/null and b/doc/images/plugins-3.png differ
diff --git a/doc/images/plugins-4.png b/doc/images/plugins-4.png
new file mode 100755
index 0000000..c3728b2
Binary files /dev/null and b/doc/images/plugins-4.png differ
diff --git a/doc/images/plugins-5.png b/doc/images/plugins-5.png
new file mode 100755
index 0000000..69349d8
Binary files /dev/null and b/doc/images/plugins-5.png differ
diff --git a/doc/images/plugins-6.png b/doc/images/plugins-6.png
new file mode 100755
index 0000000..17a0299
Binary files /dev/null and b/doc/images/plugins-6.png differ
diff --git a/doc/images/plugins-7.png b/doc/images/plugins-7.png
new file mode 100755
index 0000000..de242b0
Binary files /dev/null and b/doc/images/plugins-7.png differ
diff --git a/doc/images/sb_tit1.png b/doc/images/sb_tit1.png
new file mode 100755
index 0000000..98ca1e3
Binary files /dev/null and b/doc/images/sb_tit1.png differ
diff --git a/doc/index.html b/doc/index.html
index a088763..9e5bf95 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -5,1380 +5,1358 @@
<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
<!--[if gt IE 8]><!-->
<html lang="en-US" class="no-js">
- <!--<![endif]-->
+ <!--<![endif]-->
- <head>
- <meta charset="utf-8">
+ <head>
+ <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot (incubating) Documentation</title>
+ <title>Apache Spot (incubating) Documentation</title>
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1" />
- <link rel="apple-touch-icon" href="images/apple-touch-icon.png">
- <link rel="icon" href="favicon.png">
- <!--[if IE]>
+ <link rel="apple-touch-icon" href="images/apple-touch-icon.png">
+ <link rel="icon" href="favicon.png">
+ <!--[if IE]>
<link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
<![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="images/win8-tile-icon.png">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
-
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' href='css/style.css' type='text/css' media='all' />
-
- <link rel='stylesheet' id='mm-css-css' href='css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='js/libs/modernizr.custom.min.js'></script>
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
- <script type='text/javascript' src='js/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='js/jquery.meanmenu.js'></script>
-
- </head>
-
- <body>
-
- <div id="container">
- <header class="header">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="images/logo.png" alt="Apache Spot" /></a>
- </p>
- <div class="desktop">
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li class="menu-item">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
- </li>
- <li class="menu-item">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a href="../community">Community</a>
- <ul class="sub-menu com-sm">
- <li class="dropmenu-head">Get in Touch</li>
- <li><a href="../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
- <li class="divider"></li>
- <li><a href="../community/committers">Project Committers</a></li>
- <li><a href="../community/contribute">How to Contribute</a></li>
- <li class="divider"></li>
- <li class="dropmenu-head">Developer Resources</li>
- <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
- <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
- <li class="dropmenu-head">Social Media</li>
- <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
- </ul>
- </li>
- <li class="menu-item active">
- <a href="../doc/">Documentation</a>
- </li>
- <li class="menu-item menu-item-has-children">
- <a href="#">Project Components</a>
- <ul class="sub-menu">
- <li><a href="../project-components/open-data-models">Open Data Models</a></li>
- <li><a href="../project-components/ingestion">Ingestion</a></li>
- <li><a href="../project-components/machine-learning">Machine Learning</a></li>
- <li><a href="../project-components/visualization">Visualization</a></li>
- </ul>
- </li>
- <li class="menu-item">
- <a href="../blog">Blog</a>
- </li>
- </ul>
- </nav>
- </div>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="masthead"></div>
-
- <div id="mainwrap">
- <nav class="cbp-spmenu cbp-spmenu-vertical cbp-spmenu-left" id="cbp-spmenu-s1">
-
- <button id="showLeft"><span class="menuicon-menu"></span></button>
-
- <h3>Documents</h3>
- <a href="#introduction">Introduction <span class="icon-keyboard_arrow_right"></span></a>
- <a href="#environment">Environment <span class="icon-keyboard_arrow_right"></span></a>
- <a href="#installation" class="sub-menu">Installation <span class="icon-keyboard_arrow_right"></span></a>
- <ul>
- <li><a href="#requirements">Requirements</a></li>
- <li><a href="#deployment">Deployment</a> </li>
- <li><a href="#configuration">Configuration</a></li>
- <li><a href="#ingest">Ingest</a></li>
- <li><a href="#ml">Machine Learning</a></li>
- <li><a href="#oa">OA</a></li>
- </ul>
- <a href="#userguide" class="sub-menu">User Guide <span class="icon-keyboard_arrow_right"></span></a>
- <ul>
- <li><a href="#uflow">Flow</a></li>
- <li><a href="#udns">DNS</a> </li>
- <li><a href="#uproxy">Proxy</a></li>
- </ul>
-
- </nav>
-
- <div class="main">
- <div id="introduction">
- <h1>Introduction</h1>
- <p>
- Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.
- <br>
- </p>
- <img src="images/1.1_technical_overviewv02.jpg" style="margin:30px 0;" alt="" /><br><br>
- <h3>Parallel Ingest Framework.</h3>
- <p>
- The system uses decoders optimized from open source, that decodes binary flow and packet data, then loading the data in HDFS and data structures inside Hadoop. The decoded data is stored in multiple formats so it is available for searching, used by machine learning, transfer to law enforcement, or inputs to other systems.
- </p>
- <h3>Machine Learning.</h3>
- <p>
- The system uses a combination of Apache Spark to run scalable machine learning algorithms. The machine learning component works not only as a filter for separating bad traffic from benign, but also as a way to characterize the unique behavior of network traffic in an organization.
- </p>
- <h3>Operational Analytics.</h3>
- <p>
- In addition to machine learning, a proven process of context enrichment, noise filtering, whitelisting, and heuristics are applied to network data to produce a short list of the most likely patterns, which may be security threats.<br><br>
- </p>
- </div>
- </div>
- <div class="main tan-bg">
- <div id="environment">
- <h1>Environment</h1>
- <h3>Pure Hadoop</h3>
- <p>
- Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of CDH (see diagram below).<br><br>
-
- This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.<br><br>
- </p>
- <img src="images/pure_hadoop.png" alt="" /><br><br>
-
- <p>
- In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource manage [...]
-
- Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly <br><br>
- </p>
- <h3>Hybrid Hadoop</h3>
-
- <p>
- On existing Hadoop installations, a different approach involves using additional virtual machines and interacting with Hadoop components (Spark, HDFS) through a gateway node. This approach is recommended for customers with a Hadoop environment hosting heterogeneous use cases, where minimal deviation from node roles is desired. The disadvantage is that virtual machines must be sized properly according to workloads.<br><br>
- </p>
- <img src="images/hybrid_hadoop.png" alt="" /><br><br>
-
- <p>
- In addition to the services deployed on the existing cluster, additional Virtual Machines (VMs) are required to host the non-Hadoop functions of the solution. The gateway service is required for some of these VMs to allow for interaction with Spark, Hive, and HDFS.<br><br>
- </p>
-
- <strong>Note:</strong> While the above condition is a recommended layout for production, pilot deployments may be chosen to combine the above roles into fewer VMs. Each component of the Apache Spot (incubating) solution has integral interactions with Hadoop, but its non-Hadoop processing and memory requirements are separable with this approach.<br><br>
-
- </div>
- </div>
- <div class="main">
- <div id="installation">
- <h1>Installation</h1>
- <div id="requirements">
-
- This version of the installation guide has been validated for clusters with HDFS running CDH.<br>
- <h3>1. CDH (Cloudera Distribution of Hadoop) Requirements:</h3>
- <p>
- <strong>Minimum required version:</strong> 5.4<br>
- <strong>NOTE:</strong> Spot requires spark 1.6, if you are using CDH < 5.7 please upgrade your spark version to 1.6.</p>
- <p class="orange-bold" style="margin-bottom:0;">Required Hadoop Services before install apache spot (incubating):</p>
- <ul>
- <li>HDFS.</li>
- <li>HIVE.</li>
- <li>IMPALA.</li>
- <li>KAFKA.</li>
- <li>SPARK (YARN).</li>
- <li>YARN.</li>
- <li>Zookeeper.</li>
- </ul>
- </div>
- <div id="deployment">
- <h3>2. Deployment Recommendations</h3>
- <p class="orange-bold" style="margin-bottom:0;">There are four components in apache spot (incubating):</p>
- <ul>
- <li><strong>spot-setup</strong> — scripts that create the required HDFS paths, hive tables and configuration for apache spot (incubating).</li>
- <li><strong>spot-ingest</strong> — binary and log files are captured or transferred into the Hadoop cluster, where they are transformed and loaded into solution data stores.</li>
- <li><strong>spot-ml</strong> — machine learning algorithms are used to add additional learning information to the ingest data, which is used to filter and sort raw data.</li>
- <li><strong>spot-oa</strong>— data output from the machine learning component is augmented with context and heuristics, then is available to the user for interacting with it.</li>
- </ul>
- While all of the components can be installed on the same server in a development or test scenario, the recommended configuration for production is to map the components to specific server roles in a Hadoop cluster.<br><br>
- <table class="configuration">
- <tr>
- <th>Component</th>
- <th>Node</th>
- </tr>
- <tr>
- <td>spot-setup</td>
- <td>Edge Server (Gateway)</td>
- </tr>
- <tr>
- <td>spot-ingest</td>
- <td>Edge Server (Gateway)</td>
- </tr>
- <tr>
- <td>spot-ml</td>
- <td>YARN Node Manager</td>
- </tr>
- <tr>
- <td>spot-oa</td>
- <td>Node with Cloudera Manager</td>
- </tr>
- </table>
- </div>
- <div id="configuration">
- <h3>3. Configuring the cluster.</h3>
- <h4 class="gray">3.1 Create a user account for apache spot (incubating).</h4>
- <p>
- Before starting the installation,
- the recommended approach is to create a user account with super user privileges (sudo)
- and with access to HDFS in each one of the nodes where apache spot (incubating) is going to be installed ( i.e. edge server, yarn node).<br>
- </p>
-
- <p class="orange-bold">Add user to all apache spot (incubating) nodes:</p>
- <p class="terminal">
- sudo adduser <solution-user><br>
- passwd <solution-user>
- </p><br>
-
- <p class="orange-bold">Add user to HDFS supergroup (IMPORTANT: this should be done in the Name Node) :</p>
- <p class="terminal">
- sudo usermod -G supergroup $username
- </p><br>
-
- <h4 class="gray">3.2 Get the code.</h4>
- Go to the home directory of the solution user in the node assigned for spot-setup and spot-ingest and clone the code:<br><br>
- <p class="terminal">
- git clone https://github.com/apache/incubator-spot.git
- </p><br>
-
- <h4 class="gray">3.3 Edit apache spot (incubating) configuration.</h4>
- Go to apache spot (incubating) configuration module to edit the solution configuration:<br><br>
- <p class="terminal">
- cd /home/solution_user/incubator-spot/spot-setup<br>
- vi spot.conf
- </p><br>
-
- Configuration variables of apache spot (incubating):<br><br>
- <table class="configuration config2">
- <tr>
- <th>Key</th>
- <th>Value</th>
- <th>Need to be edited</th>
- <tr>
- <td>NODES</td>
- <td style="text-align:left">A space delimited list of the Data Nodes that will run the C/MPI part of the pipeline. Be very careful to keep * the variable in the format ('host1' 'host2' 'host3' ...). The first node is the same node as the MLNODE.</td>
- <td>No (deprecated)</td>
- </tr>
- <tr>
- <td>UINODE</td>
- <td style="text-align:left">The node that runs the spot-oa (aka, user interface node).</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>MLNODE</td>
- <td style="text-align:left">The node that runs spot-ml, controlling the other nodes. The MLNODE must be the first node in the NODES list</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>GWNODE</td>
- <td style="text-align:left">The node that runs the spot-ingest (ingest process)</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>DBNAME</td>
- <td style="text-align:left">The name of the database used by the solution (i.e. spotdb)</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>HUSER</td>
- <td style="text-align:left">HDFS user path that will be the base path for the solution; this is usually the same user that you created to run the solution (i.e. /user/"solution-user"</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>DSOURCES</td>
- <td style="text-align:left">Data sources enabled in this installation</td>
- <td>No (deprecated)</td>
- </tr>
- <tr>
- <td>DFOLDERS</td>
- <td style="text-align:left">Built-in paths for the directory structure in HDFS</td>
- <td>No</td>
- </tr>
- <tr>
- <td>DNS_PATH</td>
- <td style="text-align:left">The path to the DNS records in Hive; this will be dynamically built within the pipeline with values for No ${YR}, ${MH} and ${DY}</td>
- <td>No</td>
- </tr>
- <tr>
- <td>PROXY_PATH</td>
- <td style="text-align:left">The path to the proxy records in Hive; this will be dynamically built within the pipeline with values for ${YR}, ${MH} and ${DY}</td>
- <td>No</td>
- </tr>
- <tr>
- <td>FLOW_PATH</td>
- <td style="text-align:left">The path to the flow records in Hive; this will be dynamically built within the pipeline with values for ${YR}, ${MH} and ${DY}</td>
- <td>No</td>
- </tr>
- <tr>
- <td>HPATH</td>
- <td style="text-align:left">Path where output from the ML analysis will be stored</td>
- <td>No</td>
- </tr>
- <tr>
- <td>IMPALA_DEM</td>
- <td style="text-align:left">Node where the impala demon is running, this value can be gotten from Cloudera Manager -> Impala Yes service -> Instances.</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>KRB_AUTH</td>
- <td style="text-align:left">(default: false) Turn Kerberos authentication features on/off</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KINITPATH</td>
- <td style="text-align:left">Path to the kinit binary file</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KINITOPTS</td>
- <td style="text-align:left">Additional options to the kinit command</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KEYTABPATH</td>
- <td style="text-align:left">Keytab file path</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>KRB_USER</td>
- <td style="text-align:left">Kerberos user</td>
- <td>Only if Kerberos is enable</td>
- </tr>
- <tr>
- <td>LUSER</td>
- <td style="text-align:left">The local filesystem path for the solution, "/home/solution-user/"</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>LPATH</td>
- <td style="text-align:left">The local path for the ML intermediate and final results, dynamically built when the pipeline runs</td>
- <td>No</td>
- </tr>
- <tr>
- <td>RPATH</td>
- <td style="text-align:left">The path on the Operational Analytics node where the pipeline output will be delivered</td>
- <td>No (deprecated)</td>
- </tr>
- <tr>
- <td>LDAPATH</td>
- <td style="text-align:left">Path to the directory containing the lda code executable and configuration files.</td>
- <td>No (deprecated)</td>
- </tr>
- <tr>
- <td>LIPATH</td>
- <td style="text-align:left">Local ingest path</td>
- <td>No (deprecated)</td>
- </tr>
- <tr>
- <td>SPK_EXEC</td>
- <td style="text-align:left">Number if Spark executors</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>SPK_EXEC_MEM</td>
- <td style="text-align:left">Total memory per executor</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>SPK_DRIVER_MEM</td>
- <td style="text-align:left">Total driver memory</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>SPK_DRIVER_MAX_RESULTS</td>
- <td style="text-align:left">Total memory for driver max results</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>SPK_EXEC_CORES</td>
- <td style="text-align:left">Number of cores per executor</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>SPK_DRIVER_MEM_OVERHEAD</td>
- <td style="text-align:left">Driver memory overhead</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>SPRK_EXEC_MEM_OVERHEAD</td>
- <td style="text-align:left">Executor memory overhead</td>
- <td>Yes</td>
- </tr>
- <tr>
- <td>TOL</td>
- <td style="text-align:left">Results threshold</td>
- <td>No</td>
- </tr>
- </table>
- <br><br>
- <p><strong>NOTE:</strong> deprecated keys will be removed in the next releases.<br>
- More details about how to set up Spark properties please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/SPARKCONF.md">Spark Configuration</a></p>
-
- <h4 class="gray">3.4 Run spot-setup.</h4>
- <p class="short-mrg">Copy the configuration file edited in the previous step to "/etc/" folder.</p>
- <p class="terminal">
- sudo cp spot.conf /etc/.
- </p>
-
- <p class="short-mrg">Copy the configuration to the two nodes named as UINODE and MLNODE.</p>
- <p class="terminal">
- sudo scp spot.conf solution_user@node:/etc/.
- </p>
-
- <p class="short-mrg">Run the hdfs_setup.sh script to create folders in Hadoop for the different use cases (flow, DNS or Proxy), create the Hive database, and finally execute hive query scripts that creates Hive tables needed to access netflow, DNS and proxy data.</p>
- <p class="terminal">
- ./hdfs_setup.sh
- </p>
-
- </div>
- <div id="ingest">
- <h3>4 Ingest.</h3>
- <h4 class="gray"> 4.1 Ingest Code.</h4>
- <p>
- Copy the ingest folder (spot-ingest) to the selected node for ingest process (i.e. edge server). If you cloned the code in the edge server and you are planning to use the same server for ingest you dont need to copy the folder.
- </p>
-
- <h4 class="gray">4.2 Ingest dependencies.</h4>
- <ul>
- <li>
- <p class="short-mrg">Create a src folder to install all the dependencies.</p>
- <p class="terminal">
- cd spot-ingest <br>
- mkdir src <br>
- cd src <br>
- </p><br>
- </li>
- <li>
- <p class="short-mrg">Install pip - python package manager.</p>
- <p class="terminal">
- wget --no-check-certificate https://bootstrap.pypa.io/get-pip.py <br>
- sudo -H python get-pip.py
- </p><br>
- </li>
- <li>
- <p class="short-mrg">kafka-python (how to install) -- Python client for the Apache Kafka distributed stream processing system.</p>
- <p class="terminal">
- sudo -H pip install kafka-python
- </p><br>
- </li>
- <li>
- <p class="short-mrg">watchdog - (how to install) Python API library and shell utilities to monitor file system events.</p>
- <p class="terminal">
- sudo -H pip install watchdog
- </p><br>
- </li>
- <li>
- <p class="short-mrg">spot-nfdump - netflow dissector tool. This version is a custom version developed for apache spot (incubating) that has special features required for spot-ml.</p>
- <p class="terminal">
- sudo yum -y groupinstall "Development Tools"<br>
- git clone https://github.com/Open-Network-Insight/spot-nfdump.git <br>
- cd spot-nfdump<br>
- ./install_nfdump.sh<br>
- cd ..
- </p><br>
- </li>
- <li>
- <p class="short-mrg">tshark - DNS dissector tool. For tshark, follow the steps on the web site to install it. Tshark must be downloaded and built from <a href="https://www.wireshark.org/download.html"> Wireshark page</a></p>
- <p class="short-mrg">Full instructions for compiling Wireshark can be found <a href="https://www.wireshark.org/docs/wsug_html_chunked/ChBuildInstallUnixBuild.html">here</a> instructions for compiling</p>
- <p class="terminal">
- sudo yum -y install gtk2-devel gtk+-devel bison qt-devel qt5-qtbase-devel sudo yum -y groupinstall "Development Tools"<br>
- sudo yum -y install libpcap-devel<br>
- #compile Wireshark<br>
- wget https://1.na.dl.wireshark.org/src/wireshark-2.2.3.tar.bz2 tar xvf wireshark-2.0.1.tar.bz2<br>
- cd wireshark-2.0.1<br>
- ./configure --with-gtk2 --disable-wireshark<br>
- make<br>
- sudo make install<br>
- cd ..<br>
- </p><br>
- </li>
- <li>
- <p class="short-mrg">screen -- The screen utility is used to capture output from the ingest component for logging, troubleshooting, etc. You can check if screen is installed on the node.</p>
- <p class="terminal">
- which screen
- </p><br>
- <p class="short-mrg">If screen is not available, install it.</p>
-
- <p class="terminal">
- sudo yum install screen
- </p><br>
- </li>
- <li>
- <p class="short-mrg">Spark-Streaming – GitHub the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name). <strong>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</strong></p>
- <p class="terminal">
- cd spot-ingest/common<br>
- wget https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-kafka- 0-8-assembly_2.11/2.0.0/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar
- </p><br>
- </li>
- </ul>
-
- <h4 class="gray">4.3 Ingest configuration.</h4>
- <p class="short-mrg">Ingest Configuration:</p>
- <p class="short-mrg">The file ingest_conf.json contains all the required configuration to start the ingest module</p>
- <ul>
- <li><strong>dbname:</strong> Name of HIVE database where all the ingested data will be stored in avro-parquet format.</li>
- <li><strong>hdfs_app_path:</strong> Application path in HDFS where the pipelines will be stored (i.e /user/application_user/).</li>
- <li><strong>kafka:</strong> Kafka and Zookeeper server information required to create/listen topics and partitions.</li>
- <li><strong>collector_processes:</strong> Ingest framework uses multiprocessing to collect files (different from workers), this configuration key defines the numbers of collector processes to use.</li>
- <li><strong>spark-streaming:</strong> Proxy pipeline uses spark streaming to ingest data, this configuration is required to setup the spark application for more details please check : how to configure spark</li>
- <li><strong>pipelines:</strong> In this section you can add multiple configurations for either the same pipeline or different pipelines. The configuration name must be lowercase without spaces (i.e. flow_internals).</li>
- <li><strong>local_staging:</strong> (for each pipeline) this path is very important, ingest uses this for tmp files</li>
- </ul>
- <p class="short-mrg">For more information about spot ingest please go to <a href="https://github.com/apache/incubator-spot/tree/master/spot-ingest"> spot-ingest</a></p>
- </div>
- <div id="ml">
-
- <h3>5. Machine Learning.</h3>
- <h4 class="gray">5.1 ML code.</h4>
- <p class="short-mrg">Copy ML code to the primary ML node, the node will launch Spark application.</p>
- <p class="terminal">
- scp -r spot-ml "ml-node":/home/"solution-user"/. ssh "ml-node"
- mv spot-ml ml
- cd /home/"solution-user"/ml
- </p>
-
-
- <h4 class="gray">5.1 ML dependencies</h4>
- <ul>
- <li>
- <p class="short-mrg">Create a src folder to install all the dependencies.</p>
- <p class="terminal">
- mkdir src<br>
- cd src
- </p>
- </li>
- <li><p class="short-mrg">Install sbt -- In order to build Scala code, a SBT installation is required. Please download and install <a href="http://www.scala-sbt.org/download.html">download.</a></p></li>
- <li>
- <p class="short-mrg">Build Spark application.</p>
- <p class="terminal">
- cd ml<br>
- sbt assembly
- </p>
- </li>
- </ul>
-
- <p class="short-mrg"><strong>NOTE:</strong> validate spot.conf is already copied to this node in the following path: /etc/spot.conf</p>
- </div>
- <div id="oa">
- <h3>6. Operational Analytics.</h3>
- <h4 class="gray">6.1 OA code.</h4>
-
- <p class="short-mrg">Copy spot-oa code to the OA node designed in the configuration file (UINODE).</p>
- <p class="terminal">
- scp -r spot-oa "ml-node":/home/"solution-user"/. <br>
- ssh "oa-node"<br>
- cd /home/"solution-user"/spot-oa
- </p><br>
-
- <h4 class="gray">6.2 OA prerequisites.</h4>
- <p class="short-mrg">In order to execute this process there are a few prerequisites:</p>
- <ul>
- <li>Python 2.7.</li>
- <li>spot-ml results. Operational Analytics works and transforms Machine Learning results. The
- implementation of Machine Learning in this project is through spot-ml. Although the Operational Analytics is prepared to read csv files and there is not a direct dependency between spot-oa and spot-ml, it's highly recommended to have these two pieces set up together. If users want to implement their own machine learning piece to detect suspicious connections they need to refer to each data type module to know more about input format and schema.</li>
- <li><a href="https://pypi.python.org/pypi/tld/0.7.6"> TLD 0.7.6</a></li>
- </ul>
-
- <h4 class="gray">6.3 OA (backend) installation.</h4>
- <p class="short-mrg">OA installation consists of the configuration of extra modules or components and creation of a set of files. Depending on the data type that is going to be processed some components are required and other components are not. If users are planning to analyze the three data types supported (Flow, DNS and Proxy) then all components should be configured.</p>
- <ol>
- <li><p class="short-mrg">Add context files. Context files should go into spot-oa/context folder and they should contain network and geo localization context. For more information on context files go to spot- oa/context/ <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md">README.md</a><br></p></li>
- <li>
- <p class="short-mrg">Add a file ipranges.csv: Ip ranges file is used by OA when running data type Flow. It should contain a list of ip ranges and the label for the given range, example:</p>
- <p class="terminal">
- 10.0.0.1,10.255.255.255,Internal
- </p>
- </li>
- <li>
- <p class="short-mrg">Add a file iploc.csv: Ip localization file used by OA when running data type Flow. Create a csv file with ip ranges in integer format and give the coordinates for each range.</p>
- </li>
- <li>
- <p class="short-mrg">Add a file networkcontext_1.csv: Ip names file is used by OA when running data type DNS and Proxy. This file should contains two columns, one for Ip the other for the name, example:</p>
- <p class="terminal">
- 10.192.180.150, AnyMachine <br>
- 10.192.1.1, MySystem
- </p>
- </li>
- <li>
- <p class="short-mrg">The spot-setup project contains scripts to install the hive database and also includes the main configuration file for this tool. The main file is called spot.conf which contains different variables that the user can set up to customize their installation. Some variables must be updated in order to have spot-ml and spot-oa working.</p>
- <p class="short-mrg">To run the OA process it's required to install spot-setup. If it's already installed just make sure the following configuration are set up in spot.conf file (oa node).</p>
- <ul>
- <li><strong>LUSER:</strong> represents the home folder for the user in the Machine Learning node. It's used to know where to return feedback.</li>
- <li><strong>HUSER:</strong> represents the HDFS folder. It's used to know from where to get Machine Learning results.</li>
- <li><strong>IMPALA_DEM:</strong> represents the node running Impala daemon. It's needed to execute Impala queries in the OA process.</li>
- <li><strong>DBNAME:</strong> Hive database, the name is required for OA to execute queries against this database. LPATH: represents the local path where the feedback is going to be sent, it actually works with LUSER.</li>
- </ul>
- </li>
- <li>
- <p class="short-mrg">Configure components. Components are python modules included in this project that add context and details to the data being analyzed. There are five components and while not all components are required to every data type, it's recommended to configure all of them in case new data types are analyzed in the future. For more details about how to configure each component go to <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa [...]
- </li>
- <li>
- <p class="short-mrg">You need to update the engine.json file accordingly:</p>
- <p class="terminal">
- {
- "oa_data_engine":"<database engine>",
- "impala":{
- "impala_daemon":"<node>"
- },
- "hive":{}
- }
-
- </p>
- <p class="short-mrg">Where:</p>
- <ul>
- <li>"oa_data_engine": Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the following keys, where you'll need to add the corresponding node name.<br></li>
- <li>"impala_daemon": The node name in your cluster where you have the database service running.</li>
- </ul>
- </li>
- </ol>
- <p class="short-mrg">For more information please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md"> https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md</a></p>
-
- <h3>6.4 Visualization.</h3>
- <p>Apache Spot (incubating) - User Interface (aka Spot UI or UI) Provides tools for interactive visualization, noise filters, white listing, and attack heuristics.</p>
- <p>Here you will find instructions to get Spot UI up and running. For more information about Spot look here.</p>
-
- <h3>6.5 Visualization requirements.</h3>
- <ul>
- <li>IPython with notebook module enabled (== 3.2.0) <a href="https://ipython.org/ipython-doc/3/index.html"> link</a></li>
- <li>NPM - Node Package Manager <a href="https://www.npmjs.com"> link</a></li>
- <li>spot-oa output > Spot UI takes any output from spot-oa backend, as input for the visualization tools provided. Please make sure there are files available under PATH_TO_SPOT/ui/data/${PIPELINE}/${DATE}/</li>
- </ul>
-
- <h3>6.6 Install visualization.</h3>
- <ol>
- <li>
- <p class="short-mrg">Go to Spot UI folder:</p>
- <p class="terminal">cd spot-oa/ui</p>
- </li>
- <li>
- <p class="short-mrg">With root privileges, install browserify and uglify as global commands on your system.</p>
- <p class="terminal">npm install –g browserify uglifyjs</p>
- </li>
- <li>
- <p class="short-mrg">Install dependencies and build Spot UI.</p>
-
- <p class="terminal">npm install</p>
- </li>
- </ol>
- </div>
- </div>
- </div>
- <div class="main tan-bg">
- <div id="userguide">
- <h1>User Guide</h1>
- <div id="uflow">
- <h3>Flow</h3>
- <div id="fsc">
- <h4 class="gray" style="margin-top:0;">Suspicious Connects</h4>
- <p class="short-mrg">Access the analyst view for Suspicious Connects <strong>http://"server-ip":8889/files/ui/flow/suspicious.html</strong>. Select the date that you want to review (defaults to current date).</p>
- <p class="short-mrg">Your view should look similar to the one below:</p>
- <img src="images/1.1sc1.jpg" class="box-shadow" alt="" />
- <p class="short-mrg">
- Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
-
- <ul>
- <li>Suspicious</li>
- <li>Network View</li>
- <li>Notebook</li>
- <li>Details</li>
- </ul>
- </p>
-
- <h4 class="gray">The Suspicious frame</h4>
- <p class="short-mrg">
- Located in the top left corner of the Suspicious Connects Web Page, this frame presents the Top 250 Suspicious Connections in a table format based on Machine Learning (ML) output. These are the columns depicted in this table:</p>
- <ul>
- <li>Rank - ML output rank</li>
- <li>Time - Time received field for Netflow record</li>
- <li>Source IP - Netflow Record Source IP Address</li>
- <li>Destination IP - Netflow Record Destination IP Address</li>
- <li>Source Port - Netflow Record TCP/UDP Source Port Number</li>
- <li>Destination Port - Netflow Record TCP/UDP Destination Port Number</li>
- <li>Protocol - Text format for Protocol contained within Netflow Record (Ex. TCP/UDP)</li>
- <li>Input Packets - Reported Input Packets for the Netflow Record</li>
- <li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
- </ul>
- </p>
- <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Suspicious frame</strong>
-
- <ol>
- <li>
- By selecting a specific row within the Suspicious frame, the connection in the Network View will be highlighted.<br><br>
- <img src="images/1.1_sc2.jpg" class="box-shadow" alt="" />
-
- </li>
- <li>
- In addition, by performing this row selection the Details Frame presents all the Netflow records in between Source & Destination IP Addresses that happened in the same minute as the Suspicious Record selected<br><br>
- <img src="images/1.1_sc3.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- Next to a Source/Destination IP Addresses, a shield icon might be present. This icon denotes any reputation services value context added as part of the Operational Analytics component. By rolling over you can see the IP Address Reputation result<br><br>
- <img src="images/1.1_sc4.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- An additional icon next to the IP addresses within the Suspicious frame is the globe icon. This icon denotes Geo-localization information context added as part of the Operational Analytics component. By rolling over you can see the additional information<br><br>
- <img src="images/1.1_sc5.jpg" class="box-shadow" alt="" /><br><br>
- </li>
- </ol>
- </p>
-
- <h4 class="gray">The Network View frame</h4>
- <p class="short-mrg">Located at the top right corner of the Suspicious Connects Web Page. It is a graphical representation of the Suspicious records relationships.</p>
- <p class="short-mrg">If context has been added, Internal IP Addresses will be presented as diamonds and External IP Addresses as circles.</p>
- <img src="images/1.1_sc6.jpg" class="box-shadow" alt="" /><br><br>
- <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Network View frame</p>
- <ol>
- <li>
- <p class="short-mrg">As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.</p>
- <img src="images/1.1_sc7.jpg" class="box-shadow" alt="" />
-
- </li>
- <li>
- <p class="short-mrg">A primary mouse click over one of the nodes will bring a chord diagram into the Details frame.</p>
- <p class="short-mrg">The chord diagram is a graphical representation of the connections between the selected node and other nodes within Suspicious Connects records, providing number of Bytes From & To. You can move your mouse over an IP to get additional information. In addition, drag the chord graph to change its orientation.</p>
- <img src="images/1.1_sc8.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">A secondary mouse click uses the node information in order to apply an IP filter to the Suspicious Web Page.</p>
- <img src="images/1.1_sc9.jpg" class="box-shadow" alt="" />
- </li>
- </ol>
-
- <h4 class="gray">The Notebook frame</h4>
- <p class="short-mrg">This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score IP Addresses and Ports with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, there [...]
- <img src="images/1.1_sc10.jpg" class="box-shadow" alt="" />
-
- <h4 class="gray">The Score button</h4>
- <p class="short-mrg">When the Analyst clicks on the Score button, the action will find all coincidences exactly matching the selected values and update their score to the rating selected in the radio button list.</p>
-
- <h4 class="gray">The Save button</h4>
- <p class="short-mrg">Analysts must use Save button in order to store the scored connections. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page, including from the lists in the notebook. This will also reorder the flow_scores.csv file to move all scored connections to the end of the file and sort the rest by severity value. A shell script will be execute [...]
-
- <ul>
- <li>LPATH</li>
- <li>MLNODE</li>
- <li>LUSER</li>
- </ul>
-
- <p class="short-mrg">For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
-
- <h4 class="gray">The Quick IP Scoring box</h4>
- <p class="short-mrg">This box allows the Analyst to enter an IP Address and scored using the "Score" and "Save" buttons using the same process depicted above.</p>
-
- <h4 class="gray">Suspicious Connects Web Page Input files</h4>
- <ul>
- <li>flow_scores.csv</li>
- <li>flow_scores_bu.csv</li>
- </ul>
- </div>
- <div id="fti">
- <h4 class="gray">Threat Investigation</h4>
- <p class="short-mrg">Access the analyst view for suspicious connects <strong>http://"server-ip":8889/files/ui/flow/suspicious.html.</strong></p>
- <p class="short-mrg">Select the date that you want to review.</p>
- <p class="short-mrg">Your screen should now look like this:</p>
- <img src="images/1.1sc1.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">The analyst must score the suspicious connections before moving into Threat Investigation View, please refer to <a href="#fsc">Suspicious Connects Analyst View</a> walk-through.</p>
-
- <p class="short-mrg">Select <strong>Flows > Threat Investigation </strong> from apache spot (incubating) Menu.</p>
-
- <img src="images/1.1_ti01.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg"><strong>Threat Investigation</strong> Web Page will be opened, loading the embedded IPython notebook.</p>
- <img src="images/1.1_ti02.jpg" class="box-shadow" alt="" />
-
- <h4 class="gray">Expanded search</h4>
- <p class="short-mrg">You can select any IP from the list and click <strong>Search</strong> to view specific details about it. A query to the flow table will be executed looking into the raw data initially collected to find all communication between this and any other IP Addresses during the day, collecting additional information, such as:</p>
-
- <ul>
- <li>max & avg number of bytes sent/received</li>
- <li>max & avg number of packets sent/received</li>
- <li>destination port</li>
- <li>source port</li>
- <li>first & last connection time</li>
- <li>count of connections</li>
- </ul>
-
- <p class="short-mrg">The full output of this query is stored into the ir-<ip>.csv file. If an expanded search was previously executed on this IP, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used.</p>
-
- <p class="short-mrg">Based on the results in this file, the following functions will be executed:</p>
-
- <ul>
- <li>get_in_out_and_twoway_conns</li>
- <li>add_geospatial_info()</li>
- <li>add_network_context()</li>
- </ul>
-
- <p class="short-mrg">The system will create three dictionaries, each containing:</p>
- <ul>
- <li>Inbound connections (when the suspicious IP acts only as destination)</li>
- <li>Outbound connections (when the suspicious IP acts only as source)</li>
- <li>2Way Connections (when the suspicious IP acts as both source and destination)</li>
-
- </ul>
-
- <p class="short-mrg">If an iploc.csv file is available, each dictionary will be updated with the geolocation data for each IP.</p>
-
- <p class="short-mrg">If a network_context_1.txt file is available, a description for each identified node will also be added to each dictionary.</p>
-
- <p class="short-mrg">The connections dictionary will be separated into two smaller dictionaries, each containing</p>
- <ul>
- <li>Top 'n' IP's per number of connections.</li>
- <li>Top 'n' IP's per bytes transferred.</li>
- <li>The number of results stored in the dictionaries (n) can be set by updating the value of the top_results variable.</li>
- </ul>
-
- <h4 class="gray">Save Comments</h4>
- <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
- <p class="short-mrg">Click on the Save button after entering the data to write it into a CSV file, which eventually will be used in the Storyboard Analyst View.</p>
- <img src="images/1.1_ti03.jpg" class="box-shadow" alt="" />
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="images/win8-tile-icon.png">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' href='css/style.css' type='text/css' media='all' />
+
+ <link rel='stylesheet' id='mm-css-css' href='css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='js/jquery.meanmenu.js'></script>
+
+ </head>
+
+ <body>
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="images/logo.png" alt="Apache Spot" /></a>
+ </p>
+ <div class="desktop">
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../get-started">Get Started</a></li>
+ <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../get-started/environment">Environment</a></li>
+ <li><a href="../get-started/architecture">Architecture</a></li>
+ <li><a href="../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li class="menu-item">
+ <a href="../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../community/committers">Project Committers</a></li>
+ <li><a href="../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li class="menu-item active">
+ <a href="../doc/">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li class="menu-item">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+ </div>
- <p class="short-mrg">After creating the csv file with the analysis description, the following functions will generate all graphs and diagrams related to the IP under investigation, to populate the Storyboard Analyst view.</p>
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="masthead"></div>
+
+ <div id="mainwrap">
+ <nav class="cbp-spmenu cbp-spmenu-vertical cbp-spmenu-left" id="cbp-spmenu-s1">
+
+ <button id="showLeft"><span class="menuicon-menu"></span></button>
+
+ <h3>Documents</h3>
+
+ <a href="#environment">Environment <span class="icon-keyboard_arrow_right"></span></a>
+ <a href="#installation" class="sub-menu">Installation <span class="icon-keyboard_arrow_right"></span></a>
+ <ul>
+ <li><a href="#requirements">Requirements</a></li>
+ <li><a href="#deployment">Deployment</a> </li>
+ <li><a href="#configuration">Configuration</a></li>
+ <li><a href="#ingest">Ingest</a></li>
+ <li><a href="#ml">Machine Learning</a></li>
+ <li><a href="#oa">OA</a></li>
+ <li><a href="#ui">UI</a></li>
+ </ul>
+ <a href="#userguide" class="sub-menu">User Guide <span class="icon-keyboard_arrow_right"></span></a>
+ <ul>
+ <li><a href="#uflow">Flow</a></li>
+ <li><a href="#udns">DNS</a> </li>
+ <li><a href="#uproxy">Proxy</a></li>
+ </ul>
+ <!-- <a href="#plugins" class="sub-menu">Plugins <span class="icon-keyboard_arrow_right"></span></a> -->
+ <a href="#glossary" class="sub-menu">Glossary <span class="icon-keyboard_arrow_right"></span></a>
+ </nav>
+
+ <div class="main tan-bg">
+ <div id="environment">
+ <h1>Environment</h1>
+ <h2>Pure Hadoop</h2>
+
+ <p>Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of Hadoop (see diagram below).</p>
- <ul>
- <li>generate_attack_map_file(anchor_ip, top_inbound_b, outbound, twoway)</li>
- <li>generate_stats(anchor_ip, top_inbound_b, outbound, twoway, threat_name)</li>
- <li>generate_dendro(anchor_ip, top_inbound_b, outbound, twoway, date)</li>
- <li>details_inbound(anchor_ip,top_inbound_b)</li>
- </ul>
+ <p>This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require
+ the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.</p>
- <p><strong>generate_attack_map_file()</strong> - create a globe map indicating the trajectory of the connections based on their geolocation. This function depends on having geolocation data for each IP. If you haven't set up a geolocation database file, the map file won't be generated.<br><strong>Output:</strong> globe_<ip>.json</p>
+ <p class="center"><a href="../library/images/service-layout.png"><img src="../library/images/service-layout.png" alt="Service Layout" /></a></p>
- <p><strong>generate_stats()</strong> - This will create the horizontal bar graph for the Impact Analysis.This will represent the number of inbound, outbound and twoway connections found.<br>
- <strong>Output:</strong> stats-<ip>.json</p>
-
- <p><strong>generate_dendro()</strong> - This function creates a file linking all different IP's that have connected to the IP under investigation, this will be displayed in the Storyboard under the Incident Progression panel as a dendrogram. If no network context file is included, the dendrogram will only be 1 level deep, but if a network context file is included, additional levels will be added to the dendrogram to break down the threat activity.<br>
- <strong>Output:</strong> dendro-<ip>.json</p>
-
- <p><strong>details_inbound()</strong> - This function executes a query to the flow table, to find additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br>
- <strong>Output:</strong> sbdet-<ip>.tsv</p>
-
- <p><strong>add_threat()</strong> - This function updates/creates the threats.csv file, appending a new line for every threat analyzed. This file will serve as an index for the Storyboard and is displayed in the 'Executive Threat Briefing' panel.<br><strong>Output:</strong> threats.csv</p>
-
-
- <p>Each function will print a message to let you know if its output file was successfully updated.</p>
-
- <h4 class="gray">Continue to the Storyboard</h4>
- <p>Once you have saved comments on any suspicious IP, you can continue to the Storyboard to check the results.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
- <ul>
- <li>flow_scores.csv</li>
- <li>iploc.csv</li>
- <li>network_context_1.txt</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">Output files</p>
- <ul>
-
- <li>/oni-oa/data/flow/<date>/threats.csv</li>
- <li>/oni-oa/data/flow/<date>/threat_<ip>.csv</li>
- <li>/oni-oa/data/flow/<date>/sbdet-<ip>.tsv</li>
- <li>/oni-oa/data/flow/<date>/globe_<ip>.json</li>
- <li>/oni-oa/data/flow/<date>/stats-<ip>.json</li>
- <li>/oni-oa/data/flow/<date>/dendro-<ip>.json</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
- <ul>
- <li>flow</li>
- </ul>
-
- </div>
- <div id="fsb">
- <h4 class="gray">Storyboard</h4>
- <ol>
- <li>
- <p class="short-mrg">Select the option <strong>Flow > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/sb_tit1.JPG" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Your view should look something like this, depending on the IP's you have analyzed on the Threat Analysis for that day. You can select a different date from the calendar.</p>
- <img src="images/flow_sb_1.JPG" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Review the results:</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
- <p class="short-mrg"><strong>Data source file:</strong> threats.csv Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and the additional information will be displayed.</p>
- <p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.JPG" class="box-shadow" alt="" /></p>
-
-
- <p class="short-mrg">Clicking on a threat from the list will also update the additional frames.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Incident Progression</p>
- <p class="short-mrg"><strong>Data source file:</strong> dendro-<ip>.json<br>Frame located in the top right of the Storyboard Web page</p>
- <img src="images/flow_sb_3.JPG" class="box-shadow" alt="" />
-
- <p class="short-mrg">Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
- <p class="short-mrg">When network context is available, this graph will present an extra level to break down each type of connection into detailed context.</p>
-
- <p class="short-mrg"><strong>Impact Analysis Data source file:</strong> stats-<ip>.json</p>
- <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_4.JPG" class="box-shadow" alt="" /></p>
-
-
- <p class="short-mrg">Impact Analysis displays a horizontal bar graph representing the number of inbound, outbound and two-way connections found related to the threat. Clicking any bar in the graph, will break down that information into its context.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Map View | Globe</p>
- <p class="short-mrg"><strong>Data source file:</strong> globe_<ip>.json</p>
- <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_5.JPG" class="box-shadow" alt="" /></p>
-
- <p class="short-mrg">Map View Globe will only be created if you have a geolocation database. This is intended to represent on a global scale the communication detected, using the geolocation data of each IP to print lines on the map showing the flow of the data.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Timeline</p>
- <p class="short-mrg"><strong>Data source file:</strong> sbdet-<ip>.json</p>
- <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_6.JPG" class="box-shadow" alt="" /></p>
-
- <p class="short-mrg">Timeline is created using the resulting connections found during the Threat Investigation process. It will display 'clusters' of inbound connections to the IP, grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll.</p>
-
- <p class="short-mrg"><strong>Input files</strong></p>
- <ul>
- <li>threats.csv</li>
- <li>threat-dendro-${id}.json</li>
- <li>stats-${id}.json</li>
- <li>globe-${id}.json</li>
- <li>sbdet-${id}.tsv</li>
- </ul>
- </li>
- </ol>
- </div>
- <div id="fis">
- <h4 class="gray">Ingest Summary</h4>
- <ol>
- <li>
- <p class="short-mrg">Load the Ingest Summary page by going to <strong>http://"server-ip":8889/files/index_ingest.html</strong> or using the drop down menu.</p>
- <img src="images/is1.png" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days.
- Your view should now look like this:</p>
- <img src="images/is2.png" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Ingest Summary presents the Flows ingestion timeline, showing the total flows for a particular period of time.</p>
- <ul>
- <li>Analyst can zoom in/out on the graph.</li>
- <li>Analyst can zoom in/out on the graph.</li>
- </ul>
- </li>
- </ol>
- </div>
- </div>
- <div id="udns">
- <h3>DNS</h3>
- <div id="dsc">
- <h4 class="gray" style="margin-top:0;">Suspicious DNS</h4>
- <ol>
- <li>
- <p><strong>Open the analyst view for Suspicious DNS:</strong> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).</p>
- <p class="short-mrg">Your screen should now look like this:</p>
- <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg"><strong>The Suspicious</strong><br>Located at the top left of the Web page, this frame shows the top 250 suspicious DNS from the Machine Learning (ML) output.</p>
- <ol>
- <li>By moving the mouse over a suspicious DNS,
- you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
- </li>
- <li>
- Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
- The icon will change its color depending upon the results from specific reputation services.<br><br>
- </li>
- <li>
- By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame.
- In addition Details frame will be populated with additional communications directed to the same DNS record.<br><br>
- </li>
- </ol>
- </li>
- <li>
- <p class="short-mrg"><strong>The Network View frame</strong><br>Located at the top right corner, Network View is a graphic representation of the "Suspicious DNS".</p>
- <ol>
- <li>As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br></li>
- <li>Diamonds represents DNS records and circles represents IP addresses communicating to the respective DNS record<br><br></li>
- <li>A primary mouse click in an IP Address (circle) will bring a diagram within Details frame, providing all the Domain Name records queried by that particular IP Address<br><br></li>
- <li>A secondary mouse click uses the node information to filter suspicious data.<br><br></li>
- </ol>
- </li>
- <li>
- <p class="short-mrg"><strong>The Details frame</strong><br>
- Located at the bottom right corner of the Web page. It provides additional information for the selected connection.</p>
- <p class="short-mrg">Detail View frame has two modes:</p>
- <ul>
- <li>Table details (when you select a record in the Suspicious frame).</li>
- <li>Dendrogram diagram (when you select an IP address in the Network View frame)</li>
- </ul>
- </li>
- <li>
- <p><strong>The Notebook frame</strong><br>This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will [...]
- <p class="orange-bold" style="margin-bottom:0;">Score button</p>
- <p class="short-mrg">Pressing the 'Score' button will find all exact matches of the selected threat (Client IP or Query) in the dns_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the dns_scores.csv file at the end of the process.</p>
- <p class="short-mrg">Selecting values from both the "Client IP" and "Query" lists to score them together, will update every matching threat individually with the same rating value, but not necessarily as a Client_IP-Query pair.</p>
- <p>You can score a large set of similar or coincident queries by entering a keyword in the "Quick Scoring" text field and then select a severity value from the radiobutton list. The value entered here will only search for matches on the dns_qry_name name column. "Quick Scoring" text field has precedence over any selection made on the lists.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">The Save button</p>
- <p class="short-mrg">Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:</p>
- <ul>
- <li>LPATH</li>
- <li>MLNODE</li>
- <li>LUSER</li>
- </ul>
- </p>
- </li>
- </ol>
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
- <ul>
- <li>dns_scores.csv</li>
- <li>dns_scores_bu.csv </li>
- </ul>
- </div>
- <div id="dti">
- <h4 class="gray">DNS Threat Investigation</h4>
- <p>Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.</p>
- <p class="short-mrg">Your view should now look like this:</p>
- <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.</p>
- <p class="short-mrg">Select <strong>DNS > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/1.1_dns_ti01.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all IPs and DNS Names scored as High risk will be presented</p>
- <img src="images/1.1_dns_ti02.png" class="box-shadow" alt="" />
-
- <p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
- <p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the dns table, looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following criteria:</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular Domain Name</p>
- <p class="short-mrg">The query results will provide the different unique IP Addresses list that have queried this particular Domain, the list will be sorted by the quantity of connections.</p>
-
- <p style="text-align:center;"><img src="images/1.1_dns_ti03.jpg" class="box-shadow" alt="" /></p>
-
- <p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular IP</p>
- <p class="short-mrg">The expanded search will provide the different unique Domains list that this particular IP queried in one day, they will be sorted by the quantity of connections made to each specific Domain Name.</p>
- <p style="text-align: center;"><img src="images/1.1_dns_ti04.jpg" class="box-shadow" alt="" /></p>
-
- <p class="short-mrg">The full output of this query is stored into the threat-dendro-<threat>.csv file, from which the top 'n' results will be extracted and displayed in a table. If an expanded search was previously executed on this IP or Domain, the system will extract the results from the preexisting file to reduce the execution time by avoiding another query to the table. Query execution time is long and will vary depending on whether Hive or Impala is being used [...]
-
- <p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
- <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
- <img src="images/1.1_dns_ti05.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form. This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as a index of the threats analyzed.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Continue to the Storyboard.</p>
- <p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
- <ul>
- <li>ipython/dns/user/<date>/dns_scores.css</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">Output files</p>
- <ul>
- <li>ipython/dns/user/<date>/threats.csv</li>
- <li>ipython/dns/user/<date>/threat-dendro-<threat>.csv</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed: </p>
- <p>dns</p>
-
- </div>
- <div id="dsb">
- <h4 class="gray">DNS Storyboard</h4>
- <p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
- <ol>
- <li>
- <p>Select the option <strong>DNS > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/dns_sb_tit1.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Your view should look something like this, pending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
- <img src="images/1.1_dns_sb01.jpg" class="box-shadow" alt="" />
- </li>
- </ol>
- <p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
- <p class="short-mrg"><strong>Data source file:</strong> threats.csv<br>
- Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom area of the panel.</p>
-
- <p class="short-mrg"><strong>Incident progression Data source file:</strong> threat-dendro-<threat>.csv<br>Incident progression frame is located on the right side of the Web page.</p>
-
- <img src="images/1.1_dns_sb02.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
-
- <p class="orange-bold" style="margin-bottom: 0;">Input files</p>
- <ul>
- <li>threats.csv</li>
- <li>threat-dendro-<threat>.csv</li>
- </ul>
- </p>
- </div>
- </div>
- <div id="uproxy">
- <h3 style="margin-bottom: 0;">Proxy</h3>
- <div id="psc">
- <h4 class="gray">Suspicious Proxy</h4>
-
- <strong>Walk-through</strong>
- <ol>
- <li>
- <p class="short-mrg"><strong>Open the analyst view for Suspicious Proxy:</strong> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>. Select the date that you want to review (defaults to current date).</p>
- <p class="short-mrg">Your screen should now look like this:</p>
- <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" /><br><br>
-
- </li>
- <li>
- <p class="short-mrg"><strong>The Suspicious frame</strong><br>Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.</p>
-
- <ol>
- <li>
- By moving the mouse over a suspicious Proxy record,
- you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
- </li>
- <li>
- The Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information.
- The icon will change its color depending upon the results from the Reputation Service.<br><br>
- </li>
- <li>
- The List icon. When the user mouse over this icon, it presents the Web Categories provided by the Reputation Service<br><br>
- </li>
- <li>
- By selecting on a Suspicious Proxy record, you will highlight current row as well as the node from Network View frame. In addition,
- Details frame will be populated with additional communications directed to the same Proxy record.<br><br>
- </li>
- </ol>
- </li>
- <li>
- <p class="short-mrg"><strong>The Network View frame</strong><br>
- Located at the top right corner, Network View is a hierarchical force graph used to represent the "Suspicious Proxy" connections.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Network View Force Graph Order Hierarchy</strong></p>
- <ul>
- <li>Root Proxy Node</li>
- <li>Proxy Request Method</li>
- <li>Proxy Host</li>
- <li>Proxy Path</li>
- <li>Client IP Address</li>
- </ul><br>
- <p class="orange-bold" style="margin-bottom:0;">Network View Functionality</p>
- <ol>
- <li>
- <p class="short-mrg">As soon as you move your mouse over a node, a dialog shows up providing additional information.</p>
- <img src="images/1.1_proxy_sc02.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Graph can be zoomed in/out and can be moved in the frame</p>
- <img src="images/1.1_proxy_sc03.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">By double-clicking in the Root Proxy Node the graph can be fully expanded/collapsed</p>
- <img src="images/1.1_proxy_sc04.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">By double-clicking a node, the node can be expanded/collapsed one level</p>
- <img src="images/1.1_proxy_sc05.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">The path in yellow represents the Suspicious record selected in the suspicious frame</p>
- <img src="images/1.1_proxy_sc06.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Records will be highlighted with different colors depending upon the Risk Reputation provided by the Reputation Service</p>
- <img src="images/1.1_proxy_sc07.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames </p>
- <img src="images/1.1_proxy_sc08.jpg" class="box-shadow" alt="" />
- </li>
- </ol>
- </li>
- <li>
- <p class="short-mrg" style="margin-bottom:0;"><strong>The Details frame</strong></p>
- <p class="short-mrg">Located at the bottom right corner of the Web page. It provides additional information for the selected connection in the Suspicious frame.
- It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type, Proxy Server IP, Bytes.</p>
- <img src="images/1.1_proxy_sc09.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg"><strong>The Notebook frame</strong><br>
- This frame contains an initialized IPython Notebook. The main function is to allow the Analyst to score Proxy records with different values. In order to assign a risk to a specific connection, select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.</p>
- <img src="images/1.1_proxy_sc10.jpg" class="box-shadow" alt="" />
-
- </li>
- </ol>
-
- <p class="orange-bold" style="margin-bottom: 0;">The Score button</p>
- <p>Pressing the 'Score' button will find all exact matches of the selected threat (Proxy Record) in the proxy_scores.csv file and update them with the selected rating value. These results are temporarily stored in the score_tmp.csv file and copied back to the proxy_scores.csv file at the end of the process.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">The Save button</p>
- <p class="short-mrg">Analysts must use the Save button in order to store the scored records. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. A shell script will be executed to copy the file with the scored connections to the ML Node and specific path. The following values will be obtained from the .conf file:</p>
- <ul>
- <li>LPATH</li>
- <li>MLNODE</li>
- <li>LUSER</li>
- </ul>
-
- <p>For this process to work correctly, it's important to create an ssh key to enable secure communication between nodes, in this case, the ML node and the node where the UI runs. To learn more on how to create and copy the ssh key, please refer to the "Configure User Accounts" section.</p>
-
-
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
- <ul>
- <li>proxy_scores.csv </li>
- <li>proxy_scores_bu.csv</li>
- </ul>
- </div>
- <div id="pti">
- <h4 class="gray">Proxy Threat Investigation</h4>
- <p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
- <p class="short-mrg">Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review.</p>
- <p class="short-mrg">Your view should now look like this:</p>
- <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.</p>
- <p class="short-mrg">Select <strong>Proxy > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
- <img src="images/1.1_proxy_ti01.jpg" class="box-shadow" alt="" /><br><br>
-
- <p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all Proxy Records scored as High risk will be presented</p>
- <img src="images/1.1_proxy_ti02.jpg" class="box-shadow" alt="" /><br><br>
-
- <p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
-
- <p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the proxy table, looking into the raw data initially collected to find additional activity for the selected Proxy Record. Results will be extracted and displayed in a table. If an expanded search was previously executed on this Proxy Record, the system will extract the results from the preexisting file to reduce the execution time by avoiding anothe [...]
- <img src="images/1.1_proxy_ti03.jpg" class="box-shadow" alt="" />
- <p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
- <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.</p>
- <img src="images/1.1_proxy_ti04.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">Clicking the "Save" button, will create/update the threats.csv file, adding a new line with the contents of the form. This file is used at the Storyboard section to display all the comments entered by the user, as well it will serve as an index of the threats analyzed.</p>
-
- <p class="orange-bold" style="margin-bottom: 0;">Continue to the Storyboard.</p>
- <p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
-
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
- <ul>
- <li>proxy_scores.tsv</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">Output files</p>
- <ul>
- <li>threats.csv</li>
- <li>es-{id}.csv</li>
- <li>incident-progression-{id}.json</li>
- <li>timeline-{id}.tsv</li>
- </ul>
-
- <p class="orange-bold" style="margin-bottom:0;">HDFS tables consumed:</p>
- <p>proxy</p>
- </div>
- <div id="psb">
- <h4 class="gray">Proxy Storyboard</h4>
- <ol>
- <li>
- Select the option <strong>Proxy > Storyboard</strong> from Apache Spot (incubating) Menu.<br><br>
- <img src="images/1.1_proxy_sb01.jpg" class="box-shadow" alt="" />
- </li>
- <li>
- <p class="short-mrg">Your view should look something like this,
- depending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
- <img src="images/1.1_proxy_sb02.jpg" class="box-shadow" alt="" />
- </li>
- </ol>
-
- <p class="orange-bold">Executive Threat Briefing</p>
- <p class="short-mrg"><strong>Data source file:</strong> threats.csv<br>
- Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom area of the panel.</p>
- <p style="text-align: center;"><img src="images/1.1_proxy_sb03.jpg" class="box-shadow" alt="" /></p>
-
- <p class="orange-bold" style="margin-bottom:0;">Incident progression</p>
- <p class="short-mrg"><strong>Data source file:</strong> incident-progression-{id}.json<br>Incident progression frame is located on the right side of the Web page. Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat. It presents the following fields:</p>
- <ul>
- <li><strong>Referer</strong> - URLs that refers to the Suspicious Proxy Record</li>
- <li><strong>IP</strong> - All ip addresses connecting to the Suspicious Proxy Record</li>
- <li><strong>Method</strong> - Proxy methods used to communicate in between the IP addresses and the Proxy Record</li>
- <li><strong>ContentType</strong> - HTTP MIME Types</li>
- <li><strong>Threat</strong> - Represents the Suspicious Proxy Record</li>
- <li><strong>Referred</strong> - URLs that the Suspicious Proxy Record referred to</li>
- <img src="images/1.1_proxy_sb04.jpg" class="box-shadow" alt="" />
-
- <p class="short-mrg">If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.</p>
- <img src="images/1.1_proxy_sb06.jpg" class="box-shadow" alt="" /><br><br>
-
- <p class="orange-bold" style="margin-bottom:0;">Timeline</p>
- <p class="short-mrg"><strong>Data source file:</strong> timeline-{id}.tsv<br>Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll. The number next to the IP Address represents the quantity of [...]
- <img src="images/1.1_proxy_sb05.jpg" class="box-shadow" alt="" /><br><br>
-
- <p class="orange-bold" style="margin-bottom:0;">Input files</p>
-
- <ul>
- <li>threats.csv</li>
- <li>incident-progression-{id}.json</li>
- <li>timeline-{id}.tsv </li>
- </ul>
- </ul>
- </div>
- </div>
- </div>
- </div>
- </div><!--end main-wrap-->
-
- <div id="more-info">
- <div class="wrap cf">
-
- <p>
- <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
- </p>
-
- <p style="margin-top:50px;"><img src="images/apache-incubator.png" alt="Apache Incubator" />
- </p>
-
- <p class="disclaimer">
- Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
- </p>
-
- <p class="disclaimer">
- The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
- </p>
- </div>
+ <p>In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a
+ node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource management
+ for an ML pipeline is similar for functions inside and outside Hadoop.</p>
+
+ <p>Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly.</p>
+
+ </div>
+ </div>
+ <div class="main">
+ <div id="installation">
+ <h1>Installation</h1>
+ <div id="requirements">
+
+ This version of the installation guide has been validated for clusters with HDFS running Hadoop.<br>
+ <h3>1. Hadoop Requirements:</h3>
+ <p>
+ <strong>Minimum required version:</strong> 5.7<br>
+ <strong>NOTE:</strong> Spot requires Spark 2.1.0 if you are using Spark 1.6 please upgrade your Spark version to 2.1.0.</p>
+ <p class="orange-bold" style="margin-bottom:0;">Required Hadoop Services before install apache spot (incubating):</p>
+ <ul>
+ <li>HDFS.</li>
+ <li>HIVE.</li>
+ <li>IMPALA.</li>
+ <li>KAFKA.</li>
+ <li>SPARK (YARN).</li>
+ <li>YARN.</li>
+ <li>Zookeeper.</li>
+ </ul>
+ </div>
+ <div id="deployment">
+ <h3>2. Deployment Recommendations</h3>
+ <p class="orange-bold" style="margin-bottom:0;">There are four components in apache spot (incubating):</p>
+ <ul>
+ <li><strong>spot-setup</strong> — scripts that create the required HDFS paths, hive tables and configuration for apache spot (incubating).</li>
+ <li><strong>spot-ingest</strong> — binary and log files are captured or transferred into the Hadoop cluster, where they are transformed and loaded into solution data stores.</li>
+ <li><strong>spot-ml</strong> — machine learning algorithms are used for anomaly detection.</li>
+ <li><strong>spot-oa</strong>— data output from the machine learning component is augmented with context and heuristics, then is available to the user for interacting with it.</li>
+ </ul>
+ While all of the components can be installed on the same server in a development or test scenario, the recommended configuration for production is to map the components to specific server roles in a Hadoop cluster.<br><br>
+ <table class="configuration">
+ <tr>
+ <th>Component</th>
+ <th>Node</th>
+ </tr>
+ <tr>
+ <td>spot-setup</td>
+ <td>Edge Server (Gateway)</td>
+ </tr>
+ <tr>
+ <td>spot-ingest</td>
+ <td>Edge Server (Gateway)</td>
+ </tr>
+ <tr>
+ <td>spot-ml</td>
+ <td>YARN Node Manager</td>
+ </tr>
+ <tr>
+ <td>spot-oa</td>
+ <td>Node with Cloudera Manager</td>
+ </tr>
+ </table>
+ </div>
+ <div id="configuration">
+ <h3>3. Configuring the cluster.</h3>
+ <h4 class="gray">3.1 Create a user account for apache spot (incubating).</h4>
+ <p>
+ Before starting the installation, the recommended approach is to create a user account with super user privileges (sudo) and with access to HDFS in each one of the nodes where apache spot (incubating) is going to be installed ( i.e. edge server, yarn
+ node).<br>
+ </p>
+
+ <p class="orange-bold">Add user to all apache spot (incubating) nodes:</p>
+ <p class="terminal">
+ sudo adduser <solution-user><br> passwd <solution-user>
+ </p>
+
+ <p>For unattended execution of the ML pipeline, a public key authentication will be required. Log on to the first ML node (usually the lowest-numbered node). and create a private key for the solution user. Then you will need to copy those credentials
+ to each node used for ML.</p>
+
+ <p>[soluser@node04] ssh-keygen -t rsa<br /> [soluser@node04] ssh-copy-id soluser@node04<br /> [soluser@node04] ssh-copy-id soluser@node05<br /> …..
+ <br /> [soluser@node04] ssh-copy-id soluser@node15</p>
+
+ <p>The sample above assumes that the solution-user is “soluser” and there are 12 nodes used for ML. Now do the same for the UI node.</p>
+
+ <p>[soluser@node04] ssh-copy-id soluser@node03</p>
+
+ <p class="orange-bold">Add user to HDFS supergroup (IMPORTANT: this should be done in the Name Node) :</p>
+ <p class="terminal">
+ sudo usermod -G supergroup $username
+ </p><br>
+
+ <h4 class="gray">3.2 Get the code.</h4> Go to the download page <a href="../download/">here</a> and go to click in "Download Apache Spot".<br><br>
+
+ <h4 class="gray">3.3 Edit apache spot (incubating) configuration.</h4> Go to apache spot (incubating) configuration module to edit the solution configuration:<br><br>
+ <p class="terminal">
+ cd /home/solution_user/incubator-spot/spot-setup<br> vi spot.conf
+ </p><br> Configuration variables of apache spot (incubating):<br><br>
+ <table class="configuration config2">
+ <tr>
+ <th>Key</th>
+ <th>Value</th>
+ <th>Need to be edited</th>
+ <tr>
+ <td>NODES</td>
+ <td style="text-align:left">A space delimited list of the Data Nodes that will run the C/MPI part of the pipeline. Be very careful to keep * the variable in the format ('host1' 'host2' 'host3' ...). The first node is the same node as the
+ MLNODE.</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>UINODE</td>
+ <td style="text-align:left">The node that runs the spot-oa (aka, user interface node).</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>MLNODE</td>
+ <td style="text-align:left">The node that runs spot-ml, controlling the other nodes. The MLNODE must be the first node in the NODES list</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>GWNODE</td>
+ <td style="text-align:left">The node that runs the spot-ingest (ingest process)</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>DBNAME</td>
+ <td style="text-align:left">The name of the database used by the solution (i.e. spotdb)</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>HUSER</td>
+ <td style="text-align:left">HDFS user path that will be the base path for the solution; this is usually the same user that you created to run the solution (i.e. /user/"solution-user"</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>DSOURCES</td>
+ <td style="text-align:left">Data sources enabled in this installation</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>DFOLDERS</td>
+ <td style="text-align:left">Built-in paths for the directory structure in HDFS</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>DNS_PATH</td>
+ <td style="text-align:left">The path to the DNS records in Hive; this will be dynamically built within the pipeline with values for No ${YR}, ${MH} and ${DY}</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>PROXY_PATH</td>
+ <td style="text-align:left">The path to the proxy records in Hive; this will be dynamically built within the pipeline with values for ${YR}, ${MH} and ${DY}</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>FLOW_PATH</td>
+ <td style="text-align:left">The path to the flow records in Hive; this will be dynamically built within the pipeline with values for ${YR}, ${MH} and ${DY}</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>HPATH</td>
+ <td style="text-align:left">Path where output from the ML analysis will be stored</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>IMPALA_DEM</td>
+ <td style="text-align:left">Node where the impala demon is running, this value can be gotten from Cloudera Manager -> Impala Yes service -> Instances.</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>KRB_AUTH</td>
+ <td style="text-align:left">(default: false) Turn Kerberos authentication features on/off</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KINITPATH</td>
+ <td style="text-align:left">Path to the kinit binary file</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KINITOPTS</td>
+ <td style="text-align:left">Additional options to the kinit command</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KEYTABPATH</td>
+ <td style="text-align:left">Keytab file path</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>KRB_USER</td>
+ <td style="text-align:left">Kerberos user</td>
+ <td>Only if Kerberos is enable</td>
+ </tr>
+ <tr>
+ <td>LUSER</td>
+ <td style="text-align:left">The local filesystem path for the solution, "/home/solution-user/"</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>LPATH</td>
+ <td style="text-align:left">Deprecated</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>RPATH</td>
+ <td style="text-align:left">The path on the Operational Analytics node where the pipeline output will be delivered</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>LDAPATH</td>
+ <td style="text-align:left">Path to the directory containing the lda code executable and configuration files.</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>LIPATH</td>
+ <td style="text-align:left">Local ingest path</td>
+ <td>No (deprecated)</td>
+ </tr>
+ <tr>
+ <td>SPK_EXEC</td>
+ <td style="text-align:left">Number if Spark executors</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_EXEC_MEM</td>
+ <td style="text-align:left">Total memory per executor</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_DRIVER_MEM</td>
+ <td style="text-align:left">Total driver memory</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_DRIVER_MAX_RESULTS</td>
+ <td style="text-align:left">Total memory for driver max results</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_EXEC_CORES</td>
+ <td style="text-align:left">Number of cores per executor</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_DRIVER_MEM_OVERHEAD</td>
+ <td style="text-align:left">Driver memory overhead</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPRK_EXEC_MEM_OVERHEAD</td>
+ <td style="text-align:left">Executor memory overhead</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>SPK_AUTO_BRDCST_JOIN_THR='10485760'</td>
+ <td style="text-align:left">Default is 10MB, increase this value to make Spark broadcast tables larger than 10 MB and speed up joins.</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>TOL</td>
+ <td style="text-align:left">Results threshold</td>
+ <td>No</td>
+ </tr>
+ <tr>
+ <td>TOPIC_COUNT</td>
+ <td style="text-align:left">Number of topics used for the topic modelling at the heart of the Suspicious Connects anomaly detection</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>DUPFACTOR</td>
+ <td style="text-align:left">Used to downgrade the threat level of records similar to those marked as non-threatening by the feedback function of Spot UI</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>USER_DOMAIN</td>
+ <td style="text-align:left">Web domain associated to the user's network (for the DNS suspicious connects analysis). For example: USER_DOMAIN='intel'</td>
+ <td>Yes</td>
+ </tr>
+ <tr>
+ <td>PRECISION='64'</td>
+ <td style="text-align:left">Indicates whether spot-ml is to use 64 bit floating point numbers or 32 bit floating point numbers when representing certain probability distributions.</td>
+ <td>Yes</td>
+ </tr>
+ </table>
+ <br><br>
+ <p><strong>NOTE:</strong> deprecated keys will be removed in the next releases.<br><br /> More details about how to set up Spark properties please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/SPARKCONF.md">Spark Configuration</a></p>
+
+ <h4 class="gray">3.4 Run spot-setup.</h4>
+ <p class="short-mrg">Copy the configuration file edited in the previous step to "/etc/" folder.</p>
+ <p class="terminal">
+ sudo cp spot.conf /etc/.
+ </p>
+
+ <p class="short-mrg">Copy the configuration to the two nodes named as UINODE and MLNODE.</p>
+ <p class="terminal">
+ sudo scp spot.conf solution_user@node:/etc/.
+ </p>
+
+ <p class="short-mrg">Run the hdfs_setup.sh script to create folders in Hadoop for the different use cases (flow, DNS or Proxy), create the Hive database, and finally execute hive query scripts that creates Hive tables needed to access netflow, DNS and proxy
+ data.</p>
+ <p class="terminal">
+ ./hdfs_setup.sh
+ </p>
+
+ </div>
+ <div id="ingest">
+ <h3>4 Ingest.</h3>
+ <h4 class="gray"> 4.1 Ingest Code.</h4>
+ <p>
+ Copy the ingest folder (spot-ingest) to the selected node for ingest process (i.e. edge server). If you cloned the code in the edge server and you are planning to use the same server for ingest you dont need to copy the folder.
+ </p>
+
+ <h4 class="gray">4.2 Ingest dependencies.</h4>
+ <ul>
+ <li>
+ <p class="short-mrg">Create a src folder to install all the dependencies.</p>
+ <p class="terminal">
+ cd spot-ingest <br> mkdir src <br> cd src <br>
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">Install pip - python package manager.</p>
+ <p class="terminal">
+ wget --no-check-certificate https://bootstrap.pypa.io/get-pip.py <br> sudo -H python get-pip.py
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">kafka-python (how to install) -- Python client for the Apache Kafka distributed stream processing system.</p>
+ <p class="terminal">
+ sudo -H pip install kafka-python
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">watchdog - (how to install) Python API library and shell utilities to monitor file system events.</p>
+ <p class="terminal">
+ sudo -H pip install watchdog
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">spot-nfdump - netflow dissector tool. This version is a custom version developed for apache spot (incubating) that has special features required for spot-ml.</p>
+ <p class="terminal">
+ sudo yum -y groupinstall "Development Tools"<br> git clone https://github.com/Open-Network-Insight/spot-nfdump.git <br> cd spot-nfdump<br> ./install_nfdump.sh
+ <br> cd ..
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">tshark - DNS dissector tool. For tshark, follow the steps on the web site to install it. Tshark must be downloaded and built from <a href="https://www.wireshark.org/download.html"> Wireshark page</a></p>
+ <p class="short-mrg">Full instructions for compiling Wireshark can be found <a href="https://www.wireshark.org/docs/wsug_html_chunked/ChBuildInstallUnixBuild.html">here</a> instructions for compiling</p>
+ <p class="terminal">
+ sudo yum -y install gtk2-devel gtk+-devel bison qt-devel qt5-qtbase-devel sudo yum -y groupinstall "Development Tools"<br> sudo yum -y install libpcap-devel<br> #compile Wireshark<br> wget https://1.na.dl.wireshark.org/src/wireshark-2.2.3.tar.bz2
+ tar xvf wireshark-2.0.1.tar.bz2<br> cd wireshark-2.0.1<br> ./configure --with-gtk2 --disable-wireshark<br> make
+ <br> sudo make install<br> cd ..<br>
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">screen -- The screen utility is used to capture output from the ingest component for logging, troubleshooting, etc. You can check if screen is installed on the node.</p>
+ <p class="terminal">
+ which screen
+ </p><br>
+ <p class="short-mrg">If screen is not available, install it.</p>
+
+ <p class="terminal">
+ sudo yum install screen
+ </p><br>
+ </li>
+ <li>
+ <p class="short-mrg">Spark-Streaming – Download the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name).
+ <strong>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</strong></p>
+ <p class="terminal">
+ cd spot-ingest/common<br> wget https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-kafka- 0-8-assembly_2.11/2.0.0/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar
+ </p><br>
+ </li>
+ </ul>
+
+ <h4 class="gray">4.3 Ingest configuration.</h4>
+ <p class="short-mrg">Ingest Configuration:</p>
+ <p class="short-mrg">The file ingest_conf.json contains all the required configuration to start the ingest module</p>
+ <ul>
+ <li><strong>dbname:</strong> Name of HIVE database where all the ingested data will be stored in avro-parquet format.</li>
+ <li><strong>hdfs_app_path:</strong> Application path in HDFS where the pipelines will be stored (i.e /user/application_user/).</li>
+ <li><strong>kafka:</strong> Kafka and Zookeeper server information required to create/listen topics and partitions.</li>
+ <li><strong>collector_processes:</strong> Ingest framework uses multiprocessing to collect files (different from workers), this configuration key defines the numbers of collector processes to use.</li>
+ <li><strong>spark-streaming:</strong> Proxy pipeline uses spark streaming to ingest data, this configuration is required to setup the spark application for more details please check : how to configure spark</li>
+ <li><strong>pipelines:</strong> In this section you can add multiple configurations for either the same pipeline or different pipelines. The configuration name must be lowercase without spaces (i.e. flow_internals).</li>
+ <li><strong>local_staging:</strong> (for each pipeline) this path is very important, ingest uses this for tmp files</li>
+ </ul>
+ <p class="short-mrg">For more information about spot ingest please go to <a href="https://github.com/apache/incubator-spot/tree/master/spot-ingest"> spot-ingest</a></p>
+ </div>
+ <div id="ml">
+
+ <h3>5. Machine Learning.</h3>
+ <h4 class="gray">5.1 ML code.</h4>
+ <p class="short-mrg">Copy ML code to the primary ML node, the node will launch Spark application.</p>
+ <p class="terminal">
+ scp -r spot-ml "ml-node":/home/"solution-user"/. ssh "ml-node" mv spot-ml ml cd /home/"solution-user"/ml
+ </p>
+
+ <h4 class="gray">5.1 ML dependencies</h4>
+ <ul>
+ <li>
+ <p class="short-mrg">Create a src folder to install all the dependencies.</p>
+ <p class="terminal">
+ mkdir src<br> cd src
+ </p>
+ </li>
+ <li>
+ <p class="short-mrg">Install sbt -- In order to build Scala code, a SBT installation is required. Please download and install <a href="http://www.scala-sbt.org/download.html">download.</a></p>
+ </li>
+ <li>
+ <p class="short-mrg">Build Spark application.</p>
+ <p class="terminal">
+ cd ml<br> sbt assembly
+ </p>
+ </li>
+ </ul>
+
+ <p class="short-mrg"><strong>NOTE:</strong> validate spot.conf is already copied to this node in the following path: /etc/spot.conf</p>
</div>
+ <div id="oa">
+ <h3>6. Operational Analytics.</h3>
+ <h4 class="gray">6.1 OA code.</h4>
+
+ <p class="short-mrg">Copy spot-oa code to the OA node designed in the configuration file (UINODE).</p>
+ <p class="terminal">
+ scp -r spot-oa "ml-node":/home/"solution-user"/. <br> ssh "oa-node"<br> cd /home/"solution-user"/spot-oa
+ </p><br>
+
+ <h4 class="gray">6.2 OA prerequisites.</h4>
+ <p class="short-mrg">In order to execute this process there are a few prerequisites:</p>
+ <ul>
+ <li>Python 2.7.</li>
+ <li>spot-ml results. Operational Analytics works and transforms Machine Learning results. The implementation of Machine Learning in this project is through spot-ml. Although the Operational Analytics is prepared to read csv files and there
+ is not a direct dependency between spot-oa and spot-ml, it's highly recommended to have these two pieces set up together. If users want to implement their own machine learning piece to detect suspicious connections they need to refer
+ to each data type module to know more about input format and schema.</li>
+ <li><a href="https://pypi.python.org/pypi/tld/0.7.6"> TLD 0.7.6</a></li>
+ </ul>
+
+ <h4 class="gray">6.3 OA (backend) installation.</h4>
+ <p class="short-mrg">OA installation consists of the configuration of extra modules or components and creation of a set of files. Depending on the data type that is going to be processed some components are required and other components are not. If users are
+ planning to analyze the three data types supported (Flow, DNS and Proxy) then all components should be configured.</p>
+ <ol>
+ <li>
+ <p class="short-mrg">Add context files. Context files should go into spot-oa/context folder and they should contain network and geo localization context. For more information on context files go to spot- oa/context/ <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md">README.md</a><br></p>
+ </li>
+ <li>
+ <p class="short-mrg">Add a file ipranges.csv: Ip ranges file is used by OA when running data type Flow. It should contain a list of ip ranges and the label for the given range, example:</p>
+ <p class="terminal">
+ 10.0.0.1,10.255.255.255,Internal
+ </p>
+ </li>
+ <li>
+ <p class="short-mrg">Add a file iploc.csv: Ip localization file used by OA when running data type Flow. Create a csv file with ip ranges in integer format and give the coordinates for each range.</p>
+ </li>
+ <li>
+ <p class="short-mrg">Add a file networkcontext_1.csv: Ip names file is used by OA when running data type DNS and Proxy. This file should contains two columns, one for Ip the other for the name, example:</p>
+ <p class="terminal">
+ 10.192.180.150, AnyMachine <br> 10.192.1.1, MySystem
+ </p>
+ </li>
+ <li>
+ <p class="short-mrg">The spot-setup project contains scripts to install the hive database and also includes the main configuration file for this tool. The main file is called spot.conf which contains different variables that the user can set up to customize
+ their installation. Some variables must be updated in order to have spot-ml and spot-oa working.</p>
+ <p class="short-mrg">To run the OA process it's required to install spot-setup. If it's already installed just make sure the following configuration are set up in spot.conf file (oa node).</p>
+ <ul>
+ <li><strong>LUSER:</strong> represents the home folder for the user in the Machine Learning node. It's used to know where to return feedback.</li>
+ <li><strong>HUSER:</strong> represents the HDFS folder. It's used to know from where to get Machine Learning results.</li>
+ <li><strong>IMPALA_DEM:</strong> represents the node running Impala daemon. It's needed to execute Impala queries in the OA process.</li>
+ <li><strong>DBNAME:</strong> Hive database, the name is required for OA to execute queries against this database. </li>
+ <li><strong>LPATH:</strong> deprecated.</li>
+ </ul>
+ </li>
+ <li>
+ <p class="short-mrg">Configure components. Components are python modules included in this project that add context and details to the data being analyzed. There are five components and while not all components are required to every data type, it's recommended
+ to configure all of them in case new data types are analyzed in the future. For more details about how to configure each component go to <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/components/README.md">spot-oa/oa/components/README.md.</a></p>
+ </li>
+ <li>
+ <p class="short-mrg">You need to update the engine.json file accordingly:</p>
+ <p class="terminal">
+ { "oa_data_engine":"
+ <database engine>", "impala":{ "impala_daemon":"
+ <node>" }, "hive":{} }
+
+ </p>
+ <p class="short-mrg">Where:</p>
+ <ul>
+ <li>"oa_data_engine": Whichever database engine you have installed and configured in your cluster to work with Apache Spot (incubating). i.e. "Impala" or "Hive". For this key, the value you enter needs to match exactly with one of the
+ following keys, where you'll need to add the corresponding node name.<br></li>
+ <li>"impala_daemon": The node name in your cluster where you have the database service running.</li>
+ </ul>
+ </li>
+ </ol>
+ <p class="short-mrg">For more information please go to: <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md"> https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/INSTALL.md</a></p>
+
+ <h3>6.4 Visualization.</h3>
+ <p>Apache Spot (incubating) - User Interface (aka Spot UI or UI) Provides tools for interactive visualization, noise filters, white listing, and attack heuristics.</p>
+ <p>Here you will find instructions to get Spot UI up and running. For more information about Spot look <a href="https://github.com/apache/incubator-spot/tree/master/spot-oa/ui" target="_blank">here</a>.</p>
+
+ <h3>6.5 Visualization requirements.</h3>
+ <ul>
+ <li>IPython with notebook module enabled (== 3.2.0) <a href="https://ipython.org/ipython-doc/3/index.html"> link</a></li>
+ <li>NPM - Node Package Manager <a href="https://www.npmjs.com"> link</a></li>
+ <li>spot-oa output > Spot UI takes any output from spot-oa backend, as input for the visualization tools provided. Please make sure there are files available under PATH_TO_SPOT/ui/data/${PIPELINE}/${DATE}/</li>
+ </ul>
+
+ <div id="ui">
+ <h3>6.6 User Interface.</h3>
+ <ol>
+ <li>
+ <p class="short-mrg">Go to Spot UI folder:</p>
+ <p class="terminal">cd spot-oa/ui</p>
+ </li>
+ <li>
+ <p class="short-mrg">With root privileges, install browserify and uglify as global commands on your system.</p>
+ <p class="terminal">npm install –g browserify uglifyjs</p>
+ </li>
+ <li>
+ <p class="short-mrg">Install dependencies and build Spot UI.</p>
+
+ <p class="terminal">npm install</p>
+ </li>
+ </ol>
+ </div><!--/#ui-->
+ </div>
+ </div>
+ </div>
+ <div class="main tan-bg">
+ <div id="userguide">
+ <h1>User Guide</h1>
+ <div id="uflow">
+ <h3>Flow</h3>
+ <div id="fsc">
+ <h4 class="gray" style="margin-top:0;">Suspicious Connects</h4>
+ <p class="short-mrg">Access the analyst view for Suspicious Connects <strong>http://"server-ip":8889/files/ui/flow/suspicious.html</strong>. Select the date that you want to review (defaults to current date).</p>
+ <p class="short-mrg">Your view should look similar to the one below:</p>
+ <img src="images/1.1sc1.png" class="box-shadow" alt="" />
+ <p class="short-mrg">Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
+ <ul>
+ <li>Suspicious</li>
+ <li>Network View</li>
+ <li>Scoring</li>
+ <li>Details</li>
+ </ul>
+
+ <h4 class="gray">The Suspicious frame</h4>
+ <p class="short-mrg">
+ Located in the top left corner of the Suspicious Connects Web Page, this frame presents the Top 250 Suspicious Connections in a table format based on Machine Learning (ML) output. These are the columns depicted in this table:</p>
+ <ul>
+ <li>Rank - ML output rank</li>
+ <li>Time - Time received field for Netflow record</li>
+ <li>Source IP - Netflow Record Source IP Address</li>
+ <li>Destination IP - Netflow Record Destination IP Address</li>
+ <li>Source Port - Netflow Record TCP/UDP Source Port Number</li>
+ <li>Destination Port - Netflow Record TCP/UDP Destination Port Number</li>
+ <li>Protocol - Text format for Protocol contained within Netflow Record (Ex. TCP/UDP)</li>
+ <li>Input Packets - Reported Input Packets for the Netflow Record</li>
+ <li>Input Bytes - Reported Input Bytes for the Netflow Record</li>
+ <li>Output Packets - Reported Output Packets for the Netflow Record</li>
+ <li>Output Bytes - Reported Output Bytes for the Netflow Record</li>
+ </ul>
+ <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Suspicious frame</p>
+ <ol>
+ <li>
+ By selecting a specific row within the Suspicious frame, the connection in the Network View will be highlighted.<br><br>
+ <img src="images/1.1_sc2.png" class="box-shadow" alt="" />
+
+ </li>
+ <li>
+ In addition, by performing this row selection the Details Frame presents all the Netflow records in between Source & Destination IP Addresses that happened in the same minute as the Suspicious Record selected<br><br>
+ <img src="images/1.1_sc3.png" class="box-shadow" alt="" />
+ </li>
+ <li>
+ Next to a Source/Destination IP Addresses, a shield icon might be present. This icon denotes any reputation services value context added as part of the Operational Analytics component. By rolling over you can see the IP Address Reputation result<br><br>
+ <img src="images/1.1_sc4.png" class="box-shadow" alt="" />
+ </li>
+ <li>
+ An additional icon next to the IP addresses within the Suspicious frame is the globe icon. This icon denotes Geo-localization information context added as part of the Operational Analytics component. By rolling over you can see the additional information<br><br>
+ <img src="images/1.1_sc5.png" class="box-shadow" alt="" /><br><br>
+ </li>
+ </ol>
+ <h4 class="gray">The Network View frame</h4>
+ <p class="short-mrg">Located at the top right corner of the Suspicious Connects Web Page. It is a graphical representation of the Suspicious records relationships.</p>
+ <p class="short-mrg">If context has been added, Internal IP Addresses will be presented as diamonds and External IP Addresses as circles.</p>
+ <img src="images/1.1_sc6.png" class="box-shadow" alt="" /><br><br>
+ <p class="orange-bold" style="margin-bottom:0;">Additional functionality in Network View frame</p>
+ <ol>
+ <li>
+ <p class="short-mrg">As soon as you move your mouse over a node, a dialog shows IP address information of that particular node.</p>
+ <img src="images/1.1_sc7.png" class="box-shadow" alt="" />
+
+ </li>
+ <li>
+ <p class="short-mrg">A primary mouse click over one of the nodes will bring a chord diagram into the Details frame.</p>
+ <p class="short-mrg">The chord diagram is a graphical representation of the connections between the selected node and other nodes within Suspicious Connects records, providing number of Bytes From & To. You can move your mouse over an IP to get additional
+ information. In addition, drag the chord graph to change its orientation.</p>
+ <img src="images/1.1_sc8.png" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">A secondary mouse click uses the node information in order to apply an IP filter to the Suspicious Web Page.</p>
+ <img src="images/1.1_sc9.png" class="box-shadow" alt="" />
+ </li>
+ </ol>
+
+ <h4 class="gray">The Notebook frame</h4>
+ <p class="short-mrg">This frame contains a section where the analyst can score IP Addresses and Ports with different values. In order to assign a risk to a specific connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow down the coincidences, therefore if the analyst
+ wishes to score all connections with one same relevant attribute (i.e. src port 80), then select only the combo boxes that are relevant and leave the rest at the first row at the top.</p>
+ <img src="images/1.1_sc10.png" class="box-shadow" alt="" />
+
+ <h4 class="gray">The Score button</h4>
+ <p class="short-mrg">When the Analyst clicks on the Score button, the action will find all coincidences exactly matching the selected values and update their score to the rating selected in the radio button list.</p>
+
+ <h4 class="gray">The Save button</h4>
+ <p class="short-mrg">Analysts must use Save button in order to store the scored connections. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page, including from the lists. At the same time, the scored connections will be made available for the ML. The following values will be obtained from the spot.conf file:</p>
+
+ <ul>
+ <li>LUSER</li>
+ </ul>
+
+ <h4 class="gray">The Quick IP Scoring box</h4>
+ <p class="short-mrg">This box allows the Analyst to enter an IP Address and scored using the "Score" and "Save" buttons using the same process depicted above.</p>
+
+ </div>
+ <div id="fti">
+ <h4 class="gray">Threat Investigation</h4>
+ <p class="short-mrg">Access the analyst view for suspicious connects <strong>http://"server-ip":8889/files/ui/flow/suspicious.html.</strong></p>
+ <p class="short-mrg">Select the date that you want to review.</p>
+ <p class="short-mrg">Your screen should now look like this:</p>
+ <img src="images/1.1sc_11.png" class="box-shadow" alt="" />
+
+ <p class="short-mrg">The analyst must score the suspicious connections before moving into Threat Investigation View, please refer to <a href="#fsc">Suspicious Connects Analyst View</a> walk-through.</p>
+
+ <p class="short-mrg">Select <strong>Flows > Threat Investigation </strong> from apache spot (incubating) Menu.</p>
+
+ <img src="images/1.1_ti01.png" class="box-shadow" alt="" />
+
+ <p class="short-mrg"><strong>Threat Investigation</strong> Web Page will be opened, loading the embedded IPython notebook.</p>
+ <img src="images/1.1_ti02.png" class="box-shadow" alt="" />
+
+ <h4 class="gray">Expanded search</h4>
+ <p class="short-mrg">You can select any IP from the list and click <strong>Search</strong> to view specific details about it. A query to the flow table will be executed looking into the raw data initially collected to find all communication between this and
+ any other IP Addresses during the day, collecting additional information, such as:</p>
+
+ <ul>
+ <li>max & avg number of bytes sent/received</li>
+ <li>max & avg number of packets sent/received</li>
+ <li>destination port</li>
+ <li>source port</li>
+ <li>first & last connection time</li>
+ <li>count of connections</li>
+ </ul>
+
+ <p class="short-mrg">The full output of this query is stored into the flow_threat_investigation table.</p>
+
+ <p class="short-mrg">Based on the results from this query, a table containing the results will be displayed with the following information:</p>
+ <ul>
+ <li>Top 'n' IP's per number of connections.</li>
+ <li>Top 'n' IP's per bytes transferred.</li>
+ <li>The number of results stored in the dictionaries (n) can be set by updating the value of the top_results variable.</li>
+ </ul>
+
+ <h4 class="gray">Save Comments</h4>
+ <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP address that is under investigation.</p>
+ <p class="short-mrg">Click on the Save button after entering the data to write it into the flow_storyboard table.</p>
+ <img src="images/1.1_ti03.png" class="box-shadow" alt="" />
+
+ <p class="short-mrg">At the same time, the charts for the storyboard will be created. Depending on the existence of the geolocation database, the following graphs will be generated:</p>
+
+ <p><strong>Map view</strong> - create a globe map indicating the trajectory of the connections based on their geolocation.<br />
+ <strong>Output:</strong> globe_[threat_ip] .json</p>
+
+ <p><strong>Impact analysis</strong> - This will represent the number of inbound, outbound and twoway connections found.<br /><strong>Output:</strong> stats-[threat_ip] .json</p>
+
+ <p><strong>Dendrogram</strong> - This represents all different IP's that have connected to the IP under investigation, this will be displayed in the Storyboard under the Incident Progression panel as a dendrogram. If no network context file is included, the dendrogram will only be 1 level deep, but if a network context file is included, additional levels will be added to the dendrogram to break down the threat activity.<br /><strong>Output:</strong> dendro-[threat_ip] .json</p>
+
+ <p><strong>Timeline</strong> - This represents additional details on the IP under investigation and its connections grouping them by time; so the result will be a graph showing the number of connections occurring in a customizable timeframe.<br /><strong>Output:</strong> flow_timeline.tsv (Impala table)</p>
+
+ <p><strong>Executive threat briefing</strong> - Here the comments for the IP are displayed as a menu under the 'Executive Threat Briefing' panel.<br /><strong>Output:</strong> flow_storyboard (Impala table)</p>
+
+ <p>Once you have saved comments on any suspicious IP, you can continue to the Storyboard to check the results.</p>
+
+ </div>
+ <div id="fsb">
+ <h4 class="gray">Storyboard</h4>
+ <ol>
+ <li>
+ <p class="short-mrg">Select the option <strong>Flow > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/sb_tit1.png" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Your view should look something like this, depending on the IP's you have analyzed on the Threat Analysis for that day. You can select a different date from the calendar.</p>
+ <img src="images/flow_sb_1.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Review the results:</p>
- <footer class="footer">
+ <p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
+ <p class="short-mrg">Executive Threat Briefing lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and the additional information will be displayed.</p>
+ <p class="short-mrg" style="text-align: center"><img src="images/flow_sb_2.jpg" class="box-shadow" alt="" /></p>
- <div id="inner-footer" class="wrap cf">
- <p class="source-org copyright" style="text-align:center;">
- © 2017 Apache Spot.
- </p>
+ <p class="short-mrg">Clicking on a threat from the list will also update the additional frames.</p>
- </div>
+ <p class="orange-bold" style="margin-bottom:0;">Incident Progression</p>
+ <p class="short-mrg">Frame located in the top right of the Storyboard Web page</p>
+ <img src="images/flow_sb_3.jpg" class="box-shadow" alt="" />
- </footer>
+ <p class="short-mrg">Incident Progression displays a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
+ <p class="short-mrg">When network context is available, this graph will present an extra level to break down each type of connection into detailed context.</p>
+ <p class="short-mrg"><strong>Impact Analysis</strong></p>
+ <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_4.jpg" class="box-shadow" alt="" /></p>
+
+
+ <p class="short-mrg">Impact Analysis displays a horizontal bar graph representing the number of inbound, outbound and two-way connections found related to the threat. Clicking any bar in the graph, will break down that information into its context.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Map View | Globe</p>
+
+ <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_5.jpg" class="box-shadow" alt="" /></p>
+
+ <p class="short-mrg">Map View Globe will only be created if you have a geolocation database. This is intended to represent on a global scale the communication detected, using the geolocation data of each IP to print lines on the map showing the flow of
+ the data.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Timeline</p>
+
+ <p class="short-mrg" style="text-align: center;"><img src="images/flow_sb_6.jpg" class="box-shadow" alt="" /></p>
+
+ <p class="short-mrg">Timeline is created using the resulting connections found during the Threat Investigation process. It will display 'clusters' of inbound connections to the IP, grouped by time; showing an overall idea of the times during the day with
+ the most activity. You can zoom in or out into the graphs timeline using your mouse scroll.</p>
+
+ </li>
+ </ol>
+ </div>
+ <div id="fis">
+ <h4 class="gray">Ingest Summary</h4>
+ <ol>
+ <li>
+ <p class="short-mrg">Load the Ingest Summary page by going to <strong>http://"server-ip":8889/files/index_ingest.html</strong> or using the drop down menu.</p>
+ <img src="images/is1.png" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Select a start date, end date and click the reload button to load ingest data. Ingest summary will default to last 7 seven days. Your view should now look like this:</p>
+ <img src="images/is2.png" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Ingest Summary presents the Flows ingestion timeline, showing the total flows for a particular period of time.</p>
+ <ul>
+ <li>Analyst can zoom in/out on the graph.</li>
+ </ul>
+
+ <p class="short-mrg">By default, the ingested data for netflow will be displayed. If you want to review a different pipeline, you can change the selection in the dropdown list at the top of the page.</p>
+
+ <img src="images/netflow.png" alt="" />
+ </li>
+ </ol>
+ </div>
+ </div>
+ <div id="udns">
+ <h3>DNS</h3>
+ <div id="dsc">
+ <h4 class="gray" style="margin-top:0;">Suspicious DNS</h4>
+ <p><strong>Open the analyst view for Suspicious DNS:</strong> <i>http://"server-ip":8889/files/ui/dns/suspicious.html.</i> Select the date that you want to review (defaults to current date).</p>
+ <p class="short-mrg">Your screen should now look like this:</p>
+ <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
+
+ <ol start="2">
+ <li>Suspicious</li>
+ <li>Network View</li>
+ <li>Scoring</li>
+ </ol>
+
+ <p class="short-mrg"><strong>The Suspicious Connections</strong><br>Located at the top left of the Web page, this frame shows the top 250 suspicious DNS from the Machine Learning (ML) output.</p>
+ <ol>
+ <li>By moving the mouse over a suspicious DNS, you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
+ </li>
+ <li>
+ Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information. The icon will change its color depending upon the results from specific reputation services.<br><br>
+ </li>
+ <li>
+ By selecting on a Suspicious DNS record, you will highlight current row as well as the node from Network View frame. In addition Details frame will be populated with additional communications directed to the same DNS record.<br><br>
+ </li>
+ </ol>
+ <p class="short-mrg"><strong>The Network View Frame</strong><br>Located at the top right corner, Network View is a graphic representation of the "Suspicious DNS".</p>
+ <ol>
+ <li>As soon as you move your mouse over a node, a dialog shows up providing additional information.<br><br></li>
+ <li>Diamonds represents DNS records and circles represents IP addresses communicating to the respective DNS record<br><br></li>
+ <li>A primary mouse click in an IP Address (circle) will bring a diagram within Details frame, providing all the Domain Name records queried by that particular IP Address<br><br></li>
+ <li>A secondary mouse click uses the node information to filter suspicious data.<br><br></li>
+ </ol>
+
+ <p class="short-mrg"><strong>The Details Frame</strong><br> Located at the bottom right corner of the Web page. It provides additional information for the selected connection.</p>
+ <p class="short-mrg">Detail View frame has two modes:</p>
+ <ul>
+ <li><strong>Table details (when you select a record in the Suspicious frame).</strong></li>
+ <li><strong>Dendrogram diagram (when you select an IP address in the Network View frame)</strong></li>
+ </ul>
+
+ <p><strong>The Notebook Scoring Frame</strong><br>The main function in this frame is to allow the Analyst to score IP Addresses and DNS records with different values. In order to assign a risk to a specific
+ connection, select it using a combination of all the combo boxes, select the correct risk rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button. Selecting a value from each list will narrow
+ down the coincidences, therefore if the analyst wishes to score all connections with one same relevant attribute (i.e. ip address 10.1.1.1), then select only the combo boxes that are relevant and leave the rest at the first row at
+ the top.</p>
+ <p class="orange-bold" style="margin-bottom:0;">Score button</p>
+ <p class="short-mrg">Pressing the 'Score' button will find all exact matches of the selected threat (Client IP or Query) in the dns_scores table to set their severity value to the one selected.</p>
+ <p class="short-mrg">Selecting values from both the "Client IP" and "Query" lists to score them together, will update every matching threat individually with the same rating value, but not necessarily as a Client_IP-Query pair.</p>
+ <p>You can score a large set of similar or coincident queries by entering a keyword in the "Quick Scoring" text field and then select a severity value from the radiobutton list. The value entered here will only search for matches on the
+ dns_qry_name name column. "Quick Scoring" text field has precedence over any selection made on the lists.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">The Save button</p>
+ <p class="short-mrg">Analysts must use the Save button in order to save the scored records into the database, in the dns_threat_investigation table. After you clicking it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. At the same time, the scored connections will be made available for the ML to use as feedback. The following values will be obtained from the .conf file:</p>
+ <ul>
+ <li>LUSER</li>
+ </ul>
+
+ </div>
+ <div id="dti">
+ <h4 class="gray">DNS Threat Investigation</h4>
+ <p>Access the analyst view for DNS Suspicious Connects. Select the date that you want to review.</p>
+ <p class="short-mrg">Your view should now look like this:</p>
+ <img src="images/1.1_dns_sc01.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to DNS Suspicious Connects Analyst View walk-through.</p>
+ <p class="short-mrg">Select <strong>DNS > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/1.1_dns_ti01.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all IPs and DNS Names scored as High risk will be presented</p>
+ <img src="images/1.1_dns_ti02.png" class="box-shadow" alt="" />
+
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
+ <p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the dns table, looking into the raw data initially collected to find additional activity of the selected IP or DNS Name according to the following
+ criteria:</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular Domain Name</p>
+ <p class="short-mrg">The query results will provide the different unique IP Addresses list that have queried this particular Domain, the list will be sorted by the quantity of connections.</p>
+
+ <p style="text-align:center;"><img src="images/1.1_dns_ti03.jpg" class="box-shadow" alt="" /></p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search for a particular IP</p>
+ <p class="short-mrg">The expanded search will provide the different unique Domains list that this particular IP queried in one day, they will be sorted by the quantity of connections made to each specific Domain Name.</p>
+ <p style="text-align: center;"><img src="images/1.1_dns_ti04.jpg" class="box-shadow" alt="" /></p>
+
+ <p class="short-mrg">The full output of this query is stored into the flow_threat_investigation table. Based on the results from this query, a table containing the results will be displayed with the following information. The quantity of results displayed
+ on screen can be set by modifying the top_results variable.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
+ <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular IP or DNS query name address that is under investigation.</p>
+ <img src="images/1.1_dns_ti05.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">Click on the "Save" button after entering the data to write it into the dns_storyboard table. At the same time, the charts for the storyboard will be created.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Continue to the Storyboard.</p>
+ <p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
+
+ </div>
+ <div id="dsb">
+ <h4 class="gray">DNS Storyboard</h4>
+ <p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
+ <ol>
+ <li>
+ <p>Select the option <strong>DNS > Storyboard</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/dns_sb_tit1.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Your view should look something like this, pending on how many threats you have analyzed and commented on the Threat Analysis for that day. You can select a different date from the calendar.</p>
+ <img src="images/1.1_dns_sb01.jpg" class="box-shadow" alt="" />
+ </li>
+ </ol>
+ <p class="orange-bold" style="margin-bottom:0;">Executive Threat Briefing</p>
+ <p class="short-mrg">Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the additional comments at the bottom
+ area of the panel.</p>
+
+ <p class="short-mrg">Incident progression frame is located on the right side of the Web page.</p>
+
+ <img src="images/1.1_dns_sb02.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">This will display a tree graph (dendrogram) detailing the type of connections that conform the activity related to the threat.</p>
+ </p>
+ </div>
+ </div>
+ <div id="uproxy">
+ <h3 style="margin-bottom: 0;">Proxy</h3>
+ <div id="psc">
+ <h4 class="gray">Suspicious Proxy</h4>
+
+ <strong>Walk-through</strong>
+ <ol>
+ <li>
+ <p class="short-mrg"><strong>Open the analyst view for Suspicious Proxy:</strong> <i>http://"server-ip":8889/files/ui/proxy/suspicious.html</i>. Select the date that you want to review (defaults to current date).</p>
+ <p class="short-mrg">Your screen should now look like this:</p>
+ <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" /><br><br>
+
+ <p class="short-mrg">Suspicious Connects Web Page contains 4 frames with different functions and information:</p>
+ <ul>
+ <li>Suspicious</li>
+ <li>Network View</li>
+ <li>Scoring</li>
+ <li>Details</li>
+ </ul>
+
+ </li>
+ <li>
+ <p class="short-mrg"><strong>The Suspicious frame</strong><br>Located at the top left of the Web page, this frame shows the top 250 Suspicious Proxy connections from the Machine Learning (ML) output.</p>
+
+ <ol>
+ <li>
+ By moving the mouse over a suspicious Proxy record, you will highlight the entire row as well as a blur effect that allows you to quickly identify current connection within the Network View frame.<br><br>
+ </li>
+ <li>
+ The Shield icon. Represents the output for any Reputation Services results that has been enabled, user can mouse over in order to obtain additional information. The icon will change its color depending upon the results from the Reputation Service.<br><br>
+ </li>
+ <li>
+ The List icon. When the user mouse over this icon, it presents the Web Categories provided by the Reputation Service<br><br>
+ </li>
+ <li>
+ By selecting on a Suspicious Proxy record, you will highlight current row as well as the node from Network View frame. In addition, Details frame will be populated with additional communications directed to the same Proxy record.<br><br>
+ </li>
+ </ol>
+ </li>
+ <li>
+ <p class="short-mrg"><strong>The Network View frame</strong><br> Located at the top right corner, Network View is a hierarchical force graph used to represent the "Suspicious Proxy" connections.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Network View Force Graph Order Hierarchy</p>
+ <ul style="font-weight:bold;">
+ <li>Root Proxy Node</li>
+ <li>Proxy Request Method</li>
+ <li>Proxy Host</li>
+ <li>Proxy Path</li>
+ <li>Client IP Address</li>
+ </ul><br>
+ <p class="orange-bold" style="margin-bottom:0;">Network View Functionality</p>
+ <ol>
+ <li>
+ <p class="short-mrg">As soon as you move your mouse over a node, a dialog shows up providing additional information.</p>
+ <img src="images/1.1_proxy_sc02.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Graph can be zoomed in/out and can be moved in the frame</p>
+ <img src="images/1.1_proxy_sc03.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">By double-clicking in the Root Proxy Node the graph can be fully expanded/collapsed</p>
+ <img src="images/1.1_proxy_sc04.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">By double-clicking a node, the node can be expanded/collapsed one level</p>
+ <img src="images/1.1_proxy_sc05.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">The path in yellow represents the Suspicious record selected in the suspicious frame</p>
+ <img src="images/1.1_proxy_sc06.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Records will be highlighted with different colors depending upon the Risk Reputation provided by the Reputation Service</p>
+ <img src="images/1.1_proxy_sc07.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">A secondary mouse click over the Proxy Path or Client IP address nodes populates the Filter Box which eventually filter Suspicious & Network View Frames </p>
+ <img src="images/1.1_proxy_sc08.jpg" class="box-shadow" alt="" />
+ </li>
+ </ol>
+ </li>
+ <li>
+ <p class="short-mrg" style="margin-bottom:0;"><strong>The Details frame</strong></p>
+ <p class="short-mrg">Located at the bottom of the Web page. It provides additional information for the selected connection in the Suspicious frame. It includes columns that are not part of the Suspicious frame such as User Agent, MIME Type,
+ Proxy Server IP, Bytes.</p>
+ <img src="images/1.1_proxy_sc09.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg"><strong>The Scoring frame</strong><br> This frame contains a section where the Analyst can score Proxy records with different values. In order to assign a risk to a specific connection,
+ select the correct rating (1=High risk, 2 = Medium/Potential risk, 3 = Low/Accepted risk) and click Score button.</p>
+ <img src="images/1.1_proxy_sc10.jpg" class="box-shadow" alt="" />
+
+ </li>
+ </ol>
+
+ <p class="orange-bold" style="margin-bottom: 0;">The Score button</p>
+ <p>Pressing the 'Score' button will find all exact matches of the selected threat (Proxy Record) in the proxy_scores table and update their score to the value selected in the radio button list.</p>
+
+ <p class="orange-bold" style="margin-bottom:0;">The Save button</p>
+ <p class="short-mrg">Analysts must use the Save button in order to store the scored records into the proxy_threat_investigation table. After you click it, the rest of the frames in the page will be refreshed and the connections that you already scored will disappear on the suspicious connects page. At the same time, the scored connections will be made available for the ML to use as feedback. The following value will be obtained from the spot.conf file:</p>
+ <ul>
+ <li>LUSER</li>
+ </ul>
+ </div>
+ <div id="pti">
+ <h4 class="gray">Proxy Threat Investigation</h4>
+ <p class="orange-bold" style="margin-bottom:0;">Walk-through</p>
+ <p class="short-mrg">Access the analyst view for Proxy Suspicious Connects. Select the date that you want to review.</p>
+ <p class="short-mrg">Your view should now look like this:</p>
+ <img src="images/1.1_proxy_sc01.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">The analyst must previously score the suspicious connections before moving into Threat Investigation View, please refer to Proxy Suspicious Connects Analyst View walk-through.</p>
+ <p class="short-mrg">Select <strong>Proxy > Threat Investigation</strong> from Apache Spot (incubating) Menu.</p>
+ <img src="images/1.1_proxy_ti01.jpg" class="box-shadow" alt="" /><br><br>
+
+ <p class="short-mrg">Threat Investigation Web Page will be opened, loading the embedded IPython notebook. A list with all Proxy Records scored as High risk will be presented</p>
+ <img src="images/1.1_proxy_ti02.jpg" class="box-shadow" alt="" /><br><br>
+
+ <p class="orange-bold" style="margin-bottom:0;">Expanded Search</p>
+
+ <p class="short-mrg">Select any value from the list and press the "Search" button. The system will execute a query to the proxy table, looking into the raw data initially collected to find additional activity for the selected Proxy Record. Results will be
+ extracted and displayed as a table in the UI. The quantity of results displayed on screen can be set by modifying the top_results
+ variable, additional information on how to modify this variable can be found <a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/oa/proxy/ipynb_templates/ThreatInvestigation.md"> here</a></p>
+ <img src="images/1.1_proxy_ti03.jpg" class="box-shadow" alt="" />
+ <p class="orange-bold" style="margin-bottom:0;">Save comments.</p>
+ <p class="short-mrg">In addition, a web form is displayed under the title of 'Threat summary', where the analyst can enter a Title & Description on the kind of attack/behavior described by the particular Proxy Record that is under investigation.</p>
+ <img src="images/1.1_proxy_ti04.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">Click on the Save button after entering the data to write it into the proxy_storyboard table.</p>
+
+ <p class="orange-bold" style="margin-bottom: 0;">Continue to the Storyboard.</p>
+ <p class="short-mrg">Once you have saved comments on any suspicious IP or domain, you can continue to the Storyboard to check the results.</p>
+
+ </div>
+ <div id="psb">
+ <h4 class="gray">Proxy Storyboard</h4>
+ <ol>
+ <li>
+ Select the option <strong>Proxy > Storyboard</strong> from Apache Spot (incubating) Menu.<br><br>
+ <img src="images/1.1_proxy_sb01.jpg" class="box-shadow" alt="" />
+ </li>
+ <li>
+ <p class="short-mrg">Your view should look something like this, depending on how many threats you have analyzed and commented on the Threat Investigation page for that day. You can select a different date from the calendar.</p>
+ <img src="images/1.1_proxy_sb02.jpg" class="box-shadow" alt="" />
+ </li>
+ </ol>
+
+ <p class="orange-bold">Executive Threat Briefing</p>
+ <p class="short-mrg">Executive Threat Briefing frame lists all the incident titles you entered at the Threat Investigation notebook. You can click on any title and view the comments at the bottom area of the panel.</p>
+
+ <p style="text-align: center;"><img src="images/1.1_proxy_sb03.jpg" class="box-shadow" alt="" /></p>
+
+ <p class="orange-bold" style="margin-bottom:0;">Incident progression</p>
+ <p class="short-mrg"><strong>Data source file:</strong> incident-progression-{id}.json<br>Incident progression frame is located on the right side of the Web page. Incident Progression displays a tree graph (dendrogram) detailing the type of connections that
+ conform the activity related to the threat. It presents the following fields:</p>
+ <ul>
+ <li><strong>Referer</strong> - URLs that refers to the Suspicious Proxy Record</li>
+ <li><strong>IP</strong> - All ip addresses connecting to the Suspicious Proxy Record</li>
+ <li><strong>Method</strong> - Proxy methods used to communicate in between the IP addresses and the Proxy Record</li>
+ <li><strong>ContentType</strong> - HTTP MIME Types</li>
+ <li><strong>Threat</strong> - Represents the Suspicious Proxy Record</li>
+ <li><strong>Referred</strong> - URLs that the Suspicious Proxy Record referred to</li>
+ </ul>
+ <img src="images/1.1_proxy_sb04.jpg" class="box-shadow" alt="" />
+
+ <p class="short-mrg">If multiple IP Addresses connects to a particular Proxy Threat (URL) you can scroll down/up, arrows indicate that there are more elements in the list.</p>
+ <img src="images/1.1_proxy_sb06.jpg" class="box-shadow" alt="" /><br><br>
+
+ <p class="orange-bold" style="margin-bottom:0;">Timeline</p>
+ <p class="short-mrg">Timeline is created using the connections found during the Threat Investigation process. It will display 'clusters' of IP connections to the Proxy Record (URL), grouped by time; showing
+ an overall idea of the times during the day with the most activity. You can zoom in or out into the graphs timeline using your mouse scroll. The number next to the IP Address represents the quantity of connections made from that particular
+ IP to the Proxy Record in the displayed time.</p>
+ <img src="images/1.1_proxy_sb05.jpg" class="box-shadow" alt="" /><br><br>
+
+
+ </ul>
+ </div>
+ </div>
+ </div>
</div>
- <a href="#0" class="cd-top">Top</a>
- <script type='text/javascript' src='js/classie.js'></script>
- <script type='text/javascript' src='js/scripts.js'></script>
+ <!-- <div class="main">
+ <div id="plugins">
+ <h1>Plugins</h1>
+ <h3>Complete guide to run a plugin on SPOT web app</h3>
+
+ <p>Developers now can do a little plugin and put it on SPOT. They only need to follow next steps to reach their goal.</p>
+
+ <ol>
+ <li>Before start, we need to know a few things.
+ <ul>
+ <li>JSON: is a text to transmit data objects consisting of any serializable value. We need to know the basics because the plugin is composed by JSON.</li>
+ <li>JSON-SCHEMA-FORM: <a href="https://github.com/mozilla-services/react-jsonschema-form" target="_blank">https://github.com/mozilla-services/react-jsonschema-form</a></li>
+ <li>GraphQL: <a href="http://graphql.org/learn/" target="_blank">http://graphql.org/learn/</a></li>
+ <li>And some other backend-language if you want to connect your plugin to some 3rd party service or API’s.</li>
+ <li>Python basics</li>
+ </ul>
+ </li>
+ <li>
+ <p>Next step is know where the plugin will be placed. Nowadays we have 2 type of widget, Menu type, Scoring Type.</p>
+ <p>Menu type is just a link to a web app inside your plugin’s folder.</p>
+
+ <p><img src="images/plugins-1.png" alt="" /></p>
+
+ <p>All Menu type plugin will be placed inside Plugins menu. If there is none Menu type, the UI will recognize it. After that plugins menu will disappear.</p>
+
+ <p><img src="images/plugins-2.png" alt="" /></p>
+
+ <p>For the other hand scoring type Plugin is placed inside Scoring Panel.</p>
+
+ <p><img src="images/plugins-3.png" alt="" /></p>
+
+ <p>In the same case as Menu, if there is no plugins for this specific pipeline, scoring will take all space:</p>
+
+ <p class="center"><img src="images/plugins-4.png" alt="" /></p>
+
+ <h3>Configure and enable the widget</h3>
+
+ <p>From the top right menu, you can click on the mesh icon to display the configuration options and select the ‘Manage Plugins’ option to display the plugin manager section.</p>
+
+ <p><img src="images/plugins-5.png" alt="" /></p>
+ <p><img src="images/plugins-6.png" alt="" /></p>
+
+ <p>To enable or to activate a plugin and start the service, you can just click on the ‘Enable / Disable’ button.</p>
+
+ <p>If the specific plugin requires additional configuration and its json file is properly structured, you can set the configuration values by clicking on the pencil icon. It will open a new window displaying a form for specific requirements of the plugin.</p>
+
+ <p><img src="images/plugins-7.png" alt="" /></p>
+
+ </li>
+ </ol>
+ </div>
+ </div> -->
+
+ <div class="main">
+ <div id="glossary">
+ <h1>Glossary</h1>
+ <h3>Technicalities</h3>
+
+ <p id="perimeters-flows"><strong>Perimeters Flows:</strong> Connections with external sites.</p>
+ <p id="proxy"><strong>Proxy:</strong> Intermediary Gate (If A/Client wants to ask for a service located in C/Server, it needs to be done by B/Proxy).</p>
+ <p id="internal-flows"><strong>Internal Flows:</strong> When you are moving internally with lateral movements for example intranet (you are connected to a company network and you access to a server in this company).</p>
+ <p id="telemetry"><strong>Telemetry:</strong> Automated analysis data process to collect, classify and filter information. </p>
+ <p id="machine-learning"><strong>Machine Learning:</strong> Component working as a filter separating bad traffic from benign and characterizing the unique behavior of network traffic. </p>
+ <p id="hadoop"><strong>Hadoop</strong> Framework allowing distributed processing of large data sets across clusters of computers.</p>
+ <p id="ad-hoc"><strong>Ad-hoc</strong> Search criteria to select specific sections generating a specific report.</p>
+ <p id="netflow"><strong>Netflow</strong> IP network traffic collection.</p>
+
+ <h3>Acronyms</h3>
+ <p id="hdfs"><strong>HDFS:</strong> Hadoop Distributed File System</p>
+ <p id="ml"><strong>ML:</strong> Machine Learning</p>
+ <p id="dns"><strong>DNS:</strong> Domain Name System</p>
+ <p id="pcap"><strong>PCAP:</strong> Packet capture programming Interface</p>
+ <p id="xss"><strong>XSS:</strong> Cross Site Scripting</p>
+ <p id="mttr"><strong>MTTR:</strong> Reduction of mean time to incident detection & resolution.</p>
+ <!-- <p id="siem"><strong>SIEM:</strong></p>
+ <p id="cdh2"><strong>CDH:</strong> (Substitution) Moy</p>
+ <p id="src"><strong>SRC:</strong> Domain Name System</p> -->
+
+ <h3>Links</h3>
+ <p id="hdfs2"><strong>HDFS.</strong><br />The Hadoop Distributed File System (HDFS) is a distributed file system designed to run on commodity hardware. <br /><a href="https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html" target="_blank">https://hadoop.apache.org/docs/r1.2.1/hdfs_design.html</a></p>
+
+ <p id="hive"><strong>HIVE.</strong><br />The Apache Hive data warehouse software facilitates reading, writing, and managing large datasets residing in distributed storage using SQL.<br /><a href="https://hive.apache.org/" target="_blank">https://hive.apache.org/</a></p>
+
+ <p id="impala"><strong>IMPALA.</strong><br />Apache Impala (incubating) is the open source, native analytic database for Apache Hadoop. Impala is shipped by Cloudera, MapR, Oracle, and Amazon.<br />
+ <a href="https://impala.incubator.apache.org/" target="_blank">https://impala.incubator.apache.org/</a></p>
+
+ <p id="kafka"><strong>KAFKA.</strong><br />Kafka™ is used for building real-time data pipelines and streaming apps. It is horizontally scalable, fault-tolerant, wicked fast, and runs in production in thousands of companies.<br /><a href="https://kafka.apache.org/"
+ target="_blank">https://kafka.apache.org/</a></p>
+
+ <p id="spark-yarn"><strong>SPARK (YARN).</strong><br />Apache Spark is a fast and general engine for large-scale data processing.<br /><a href="https://spark.apache.org/" target="_blank">https://spark.apache.org/</a></p>
+
+ <p id="yarn"><strong>YARN.</strong><br />The fundamental idea of YARN is to split up the functionalities of resource management and job scheduling/monitoring into separate daemons.<br /><a href="https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/YARN.html"
+ target="_blank">https://hadoop.apache.org/docs/r2.7.2/hadoop-yarn/hadoop-yarn-site/YARN.html</a></p>
+
+ <p id="zookeeper"><strong>Zookeeper.</strong><br />Apache ZooKeeper is an effort to develop and maintain an open-source server which enables highly reliable distributed coordination.<br /><a href="https://zookeeper.apache.org/" target="_blank">https://zookeeper.apache.org/</a></p>
+
+ </div>
+ </div>
+
+ </div>
+ <!--end main-wrap-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications,
+ and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project
+ has yet to be fully endorsed by the ASF.
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2017 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='js/classie.js'></script>
+ <script type='text/javascript' src='js/scripts.js'></script>
- </body>
+ </body>
</html>
<!-- end of site. what a ride! -->
diff --git a/get-started/index.html b/download/index.html
similarity index 58%
copy from get-started/index.html
copy to download/index.html
index 1e8ad45..4428f34 100755
--- a/get-started/index.html
+++ b/download/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Get Started - Apache Spot</title>
+ <title>Download - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -54,7 +54,7 @@
</script>
</head>
- <body class="page">
+ <body class="page download">
<div id="container">
<header class="header">
@@ -67,18 +67,21 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
- <a target="_blank" href="../get-started">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children">
+ <a href="../get-started">Get Started</a>
<ul class="sub-menu">
- <li class="active"><a href="../get-started">Get Started</a></li>
- <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../get-started">Get Started</a></li>
+ <li><a href="../get-started/supporting-apache/">Supporting Apache</a></li>
<li><a href="../get-started/environment">Environment</a></li>
<li><a href="../get-started/architecture">Architecture</a></li>
<li><a href="../get-started/demo">Demo</a></li>
</ul>
</li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <li id="menu-item-5" class="active menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
@@ -128,59 +131,80 @@
<div class="wrap cf">
- <h1>Getting Started</h1>
- <hr />
- <h2>Apache Spot (Incubating)</h2>
-
- <p>Apache Spot is open source software for leveraging insights from flow and packet analysis. It helps enterprises and service providers gain insight on their network environments through transparency of service delivery and identification of potential security threats or attacks happening among resources operating at cloud scale. While current threat intelligence tools help, identifying unknown threats and attacks remains a challenge. Apache Spot provides tools to accele [...]
-
- <p>Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.</p>
-
- <h2>Overview</h2>
-
- <p>With the arrival of big data platforms, security organizations can now make data-driven decisions about how they protect their assets. Records of network traffic, captured as network flows, are often stored and analyzed for use in network management. An organization can use this same information to gain insight into what channels corporate information flows through.</p>
-
- <p>By taking into account additional context such as prevalent attacks and key protocols to the organization, the security team can develop a strategy that applies the right amount of per-channel risk mitigation based on the value of the data flowing through it. For an organization, we call this "the port perspective".</p>
-
- <p>There are two vectors that all organizations should evaluate:</p>
-
- <ul>
- <li>A "wide enough, deep enough" protection strategy that involves both edge prevention and sophisticated detection of unusual behavior</li>
- <li>A deep inspection of key protocols using methods that can scale to the volume of data flowing across that channel</li>
- </ul>
-
- <p>While inspecting specific, unique flows of data that may be important for individual organizations, all organizations can realize significant risk reduction from analysis of network flows and DNS (domain name service) replies.</p>
-
- <p>Apache Spot by leveraging strong technology in both Big Data and Scientific Computing disciplines is a solution intended to support this strategy by focusing on “hard security problems” detecting events such as lateral movement, side-channel data escapes, insider issues, or stealthy behavior in general.</p>
-
- <p style="text-align:center;margin:35px 0;"><img src="../library/images/how-it-works.png" alt="" /></p>
-
- <h3>Telemetry</h3>
- <ul>
- <li>Flows.</li>
- <li>DNS (pcaps).</li>
- <li>Proxy.</li>
- </ul>
-
- <h3>Parallel Ingest Framework</h3>
- <ul>
- <li>Open source decoders.</li>
- <li>Load data in Hadoop.</li>
- <li>Data transformation.</li>
- </ul>
-
- <h3>Machine Learning</h3>
- <ul>
- <li>Filter billion of events to a few thousands.</li>
- <li>Unsupervised learning.</li>
- </ul>
+ <p class="center">
+ <img src="../library/images/download-logo.png" alt="" /><br />
+ <img src="../library/images/download.png" alt="" />
+ </p>
+
+ <p class="center">Apache Spot 1.0 is the latest release. The current version is Apache Spot 1.0</p>
+
+ <div class="content-wrap">
+ <p><strong>1.0</strong></p>
+ <ul>
+ <li>Released August 7, 2017.</li>
+ <li><a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12320637&version=12340668" target="_blank">Release Notes.</a></li>
+ <li><a href="http://apache.org/dyn/closer.cgi/incubator/spot/1.0-incubating/apache-spot-1.0-incubating.tar.gz" target="_blank">Download Apache Spot.</a></li>
+ <li>Verify this release using 1.0 signatures and checksums[<a href="http://www-eu.apache.org/dist/incubator/spot/1.0-incubating/apache-spot-1.0-incubating.tar.gz.asc" target="_blank">PGP</a>, <a href="http://www-eu.apache.org/dist/incubator/spot/1.0-incubating/apache-spot-1.0-incubating.tar.gz.sha512" target="_blank">SHA-512</a>, <a href="http://www-eu.apache.org/dist/incubator/spot/1.0-incubating/apache-spot-1.0-incubating.tar.gz.md5" target="_blank">MD5</a>] with pr [...]
+ </ul>
+ </div>
- <h3>Operational Analytics</h3>
- <ul style="margin-bottom:50px;">
- <li>Visualization.</li>
- <li>Attack heuristics.</li>
- <li>Noise filter.</li>
- </ul>
+ <div class="content-wrap">
+ <p><strong>Validate Build:</strong></p>
+ <ul>
+ <li>Download the tarball.</li>
+ <li>Decompress the tarball. Instruction:
+ <span class="indent"><strong>tar -zxvf apache-spot-1.0-incubating.tar.gz</strong></span>
+ </li>
+ <li>Change directory. Instruction:
+ <span class="indent"><strong>cd apache-spot-1.0-incubator</strong></span>
+ </li>
+ </ul>
+ <p>Apache Spot (incubating) is composed of more than one module or sub-projects. Since some of them are Python or Javascript code, they don’t need compilation.</p>
+
+ <p>For more instructions about how to install each module please read below instructions.</p>
+ <ul>
+ <li>You should see the content of the folder:
+ <span class="indent">
+ spotadmin-mac01:apache-spot-1.0-incubating spotadmin$ ls -la<br />
+ total 72<br />
+ drwxr-xr-x 14 spotadmin staff 476 Jul 24 16:45 .<br />
+ drwxr-xr-x 7 spotadmin staff 238 Aug 4 09:32 ..<br />
+ -rw-r--r-- 1 spotadmin staff 20 Jul 24 16:45 .gitignore<br />
+ -rw-r--r-- 1 spotadmin staff 0 Jul 24 16:45 .gitmodules<br />
+ -rw-r--r-- 1 spotadmin staff 560 Jul 24 16:45 DISCLAIMER<br />
+ -rw-r--r-- 1 spotadmin staff 11918 Jul 24 16:45 LICENSE<br />
+ -rw-r--r-- 1 spotadmin staff 1493 Jul 24 16:45 LICENSE-topojson.txt<br />
+ -rw-r--r-- 1 spotadmin staff 159 Jul 24 16:45 NOTICE<br />
+ -rw-r--r-- 1 spotadmin staff 6761 Jul 24 16:45 README.md<br />
+ drwxr-xr-x 3 spotadmin staff 102 Jul 24 16:45 docs<br />
+ drwxr-xr-x 10 spotadmin staff 340 Jul 24 16:45 spot-ingest<br />
+ drwxr-xr-x 13 spotadmin staff 442 Jul 24 16:45 spot-ml<br />
+ drwxr-xr-x 11 spotadmin staff 374 Jul 24 16:45 spot-oa<br />
+ drwxr-xr-x 10 spotadmin staff 340 Jul 24 16:45 spot-setup
+ </span>
+ </li>
+ <li>Decompressed tarball content should be the same with the content located in:<br />
+ <a href="https://github.com/apache/incubator-spot/tree/v1.0-incubating" target="_blank">https://github.com/apache/incubator-spot/tree/v1.0-incubating</a>
+ </li>
+ <li>To install the properly component please follow this guide:<br />
+ <a href="../doc/#installation">http://spot.apache.org/doc/#installation</a>
+
+ <p>
+ Spot-ingest, Spot-setup, Spot UI and Spot-OA have specific requirements to install manually.<br />
+ <a href="../doc/#configuration">http://spot.apache.org/doc/#configuration</a><br />
+ <a href="../doc/#ingest">http://spot.apache.org/doc/#ingest</a><br />
+ <a href="../doc/#oa">http://spot.apache.org/doc/#oa</a><br />
+ <a href="../doc/#ui">http://spot.apache.org/doc/#ui</a>
+ </p>
+
+ </li>
+ <li>Spot-ML is the only component to build the binary files using <strong>sbt assembly</strong> commands.<br />
+ Please follows these instructions.<br />
+ <a href="../doc/#ml">http://spot.apache.org/doc/#ml</a>
+ </li>
+
+ </ul>
+ </div>
</div><!--/.wrap-->
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index 23ecbd6..e821436 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -68,7 +68,7 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
- <a target="_blank" href="../../get-started">Get Started</a>
+ <a href="../../get-started">Get Started</a>
<ul class="sub-menu">
<li><a href="../../get-started">Get Started</a></li>
<li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
index f34c54c..03811e4 100755
--- a/get-started/demo/index.html
+++ b/get-started/demo/index.html
@@ -68,7 +68,7 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
- <a target="_blank" href="../../get-started">Get Started</a>
+ <a href="../../get-started">Get Started</a>
<ul class="sub-menu">
<li><a href="../../get-started">Get Started</a></li>
<li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
index 4d9e965..12c6091 100755
--- a/get-started/environment/index.html
+++ b/get-started/environment/index.html
@@ -68,7 +68,7 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
- <a target="_blank" href="../../get-started">Get Started</a>
+ <a href="../../get-started">Get Started</a>
<ul class="sub-menu">
<li><a href="../../get-started">Get Started</a></li>
<li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
@@ -134,9 +137,9 @@
<h2>Pure Hadoop</h2>
- <p>Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of CDH (see diagram below).</p>
+ <p>Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of Hadoop (see diagram below).</p>
- <p>This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.</p>
+ <p>This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by some systems.</p>
<p class="center"><a href="../../library/images/service-layout.png"><img src="../../library/images/service-layout-sm.png" alt="Service Layout" /></a></p>
diff --git a/get-started/index.html b/get-started/index.html
index 1e8ad45..a0a49b4 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -68,7 +68,7 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
- <a target="_blank" href="../get-started">Get Started</a>
+ <a href="../get-started">Get Started</a>
<ul class="sub-menu">
<li class="active"><a href="../get-started">Get Started</a></li>
<li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../community">Community</a>
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
index 5ca3f2d..e90ae88 100755
--- a/get-started/supporting-apache/index.html
+++ b/get-started/supporting-apache/index.html
@@ -68,7 +68,7 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
- <a target="_blank" href="../../get-started">Get Started</a>
+ <a href="../../get-started">Get Started</a>
<ul class="sub-menu">
<li><a href="../../get-started">Get Started</a></li>
<li class="active"><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/index.html b/index.html
index 1b6ff9c..c36a46f 100755
--- a/index.html
+++ b/index.html
@@ -77,7 +77,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="community">Community</a>
diff --git a/library/css/meanmenu.css b/library/css/meanmenu.css
index 025901b..9f641d4 100755
--- a/library/css/meanmenu.css
+++ b/library/css/meanmenu.css
@@ -214,6 +214,22 @@ a.meanmenu-reveal {
background:rgba(255,255,255,.1) url('../images/twitter-icon.png') no-repeat;
}
+@media only screen and (max-width:1030px) {
+ .under-dev {
+ background:#aea698;
+ color:#fff;
+ font-weight:700;
+ text-transform: uppercase;
+ padding:10px;
+ width:100%;
+ border-bottom:1px solid #ccc;
+ line-height: 1.4em;
+ font-size:11pt;
+ letter-spacing: 1px;
+ text-align: center;
+ }
+}
+
@media only screen and (min-width:768px) {
.mean-container .mean-nav .slack {
background-position:left 7% center !important;
@@ -230,4 +246,4 @@ a.meanmenu-reveal {
.mean-container .mean-nav .twitter-icon {
background-position:left 7% center !important;
}
-}
\ No newline at end of file
+}
diff --git a/library/css/style.css b/library/css/style.css
index fcc568a..dc990f7 100755
--- a/library/css/style.css
+++ b/library/css/style.css
@@ -598,6 +598,14 @@ img { max-width: 100%; height: auto; }
.header { box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -webkit-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -moz-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); }
.thin {font-weight:400;}
+
+.green {color:#8e8506;}
+
+.cont-table {border:2px solid #ccc; background:#fff;margin:25px 0;}
+.cont-table tr {padding:10px;border-top:2px solid #ccc;}
+.cont-table td {padding:10px;border-left:2px solid #ccc;}
+.cont-table td:first-of-type {border-left:none #ccc;}
+
/********************
WORDPRESS BODY CLASSES
style a page via class
@@ -747,7 +755,7 @@ HEADER STYLES
#logo a { color: white; }
#masthead { background: url("../images/masthead-bg.jpg") no-repeat bottom center; background-size: cover; clear: both; padding: 50px 0; -webkit-box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); text-align: center; }
-#masthead h1 { color: #f9bf12; line-height: 1.2em; max-width: 600px; text-align: center; display: block; margin: 0 auto;color:#fff;font-weight:bold;letter-spacing:1px;}
+#masthead h1 { color: #f9bf12; line-height: 1.2em; max-width: 600px; text-align: center; display: block; margin: 0 auto;color:#fff;font-weight:bold;letter-spacing:1px;text-shadow: 0 0 12px rgba(0,0,0,.85);}
#masthead h1.thin {font-weight:400;}
#masthead p { color: #fff; line-height: 1.8em; text-align: center; letter-spacing: 1px; font-size: 11pt; }
#masthead .contribute h3 {color:#fff;letter-spacing:1px;font-size:1.3em;font-weight:500;}
@@ -784,6 +792,8 @@ keep this file as small as possible!
*/ }
.nav li ul.sub-menu li a, .nav li ul.children li a { padding-left: 30px; }
.menu-item-has-children > a {cursor:default;}
+ul.sub-menu li {margin-bottom:0;}
+
/* end .nav */
/*********************
POSTS & CONTENT STYLES
@@ -859,6 +869,7 @@ POSTS & CONTENT STYLES
.page #content h3 {color:#a3a3a1;font-weight:700;text-transform:uppercase;line-height:1.3em;font-size:1.3em;}
.page #content h4 {color:#8e8506;font-weight:400;}
.page .wrap.with-sidebar {width:100%;}
+.page #content h3.green {color:#8e8506;font-weight:500;text-transform: none;}
.divTable{
@@ -900,6 +911,30 @@ POSTS & CONTENT STYLES
background-color:rgba(232,229,224,.6);
}
+.download .content-wrap {
+ max-width:700px;
+ border-bottom:15px solid #4b4547;
+ display: block;
+ margin:25px auto;
+ padding:0 25px;
+ font-size: 17px;
+}
+.download .content-wrap:first-of-type {
+ border-top:15px solid #4b4547;
+}
+.download .content-wrap a {
+ color:#4eafe7;
+}
+
+.download #content {
+ margin-bottom:50px;
+}
+.content-wrap .indent {
+ display:block;
+ padding-left:40px;
+ margin:15px 0;
+}
+
.hentry { padding: .75em; margin-bottom: 1.5em; }
.hentry footer { padding: 1.5em 0; border-top: 1px solid #d6d6d6; }
.hentry footer p { margin: 0; }
@@ -1132,11 +1167,11 @@ you can add resource intensive styles.
#masthead p { text-align: left; }
.page #masthead .wrap {min-height:250px;}
.page #masthead h1 {text-align:center;margin:0 auto;}
-
+
/* end .nav */
-
-
+
+
/********************* CONTENT ********************/
#how-it-works { padding: 100px 0; text-align: left; }
#how-it-works img { display: block; margin: 0 auto; }
@@ -1191,9 +1226,9 @@ in general anyone not viewing on a mobile device. Here's where
you can add resource intensive styles.
*********************/
@media only screen and (min-width: 1030px) { /****************************************************************** Site Name: Author: Stylesheet: Desktop Stylsheet This is the desktop size. It's larger than an iPad so it will only be seen on the Desktop. *****************************************************************/
- #logo { float: left; text-align: left; }
+ #logo { float: left; text-align: left; }
.wrap, .page .wrap.with-sidebar { width: 1040px; }
- .cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
+ .cd-top { height: 60px; width: 60px; right: 30px;bottom: 30px; }
.nav li a { padding: .75em 1.6em; }
.nav li:last-child a {padding-right:0;}
/********************* NAVIGATION STYLES ********************/
@@ -1202,7 +1237,7 @@ you can add resource intensive styles.
.nav li { float: left; position: relative; /*
plan your menus and drop-downs wisely.
*/ /* showing sub-menus */ }
- .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.5em; /*
+ .nav li a { border-bottom: 0; color: #626366; font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 700; text-transform: uppercase; font-size: 10.2pt; letter-spacing: 1px; padding: .75em 1.2em; /*
you can use hover styles here even though this size
has the possibility of being a mobile device.
*/ }
@@ -1210,7 +1245,7 @@ has the possibility of being a mobile device.
.nav li.active > a {color:#c97644;}
.nav li ul.sub-menu, .nav li ul.children { width:235px;margin-top: 0; position: absolute; visibility: hidden;opacity:0; z-index: 8999;padding-left:0; -webkit-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-moz-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s;-ms-transition: all 0.3s ease-in-out 0s, visibility 0s linear 0.3s, z-index 0s linear 0.01s; -o-transition: all 0.3s ease-in-out 0s, visibility 0s line [...]
- .nav li ul.sub-menu li a, .nav li ul.children li a { float:none;padding-left: 10px; border-right: 0; display: block; width: 235px; border-bottom: 1px solid #ccc; }
+ .nav li ul.sub-menu li a, .nav li ul.children li a { float:none;padding-left: 10px; border-right: 0; display: block; width: 235px; border-bottom: 1px solid #ccc; line-height: 1.4em;}
.nav li ul.sub-menu li a:hover, .nav li ul.children li a:hover {color:#c97644;}
.nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
.nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
@@ -1218,6 +1253,20 @@ has the possibility of being a mobile device.
.nav li ul.sub-menu.com-sm li a {
border-bottom:none;
}
+
+.under-dev {
+ background:#aea698;
+ color:#fff;
+ font-weight:700;
+ text-transform: uppercase;
+ padding:10px;
+ width:100%;
+ border-bottom:1px solid #ccc;
+ line-height: 1.4em;
+ font-size:10.2pt;
+ letter-spacing: 1px;
+ text-align: center;
+}
.dropmenu-head {
float: none;
border-right: 0;
@@ -1271,16 +1320,16 @@ li.divider {
.arrow { height: 80px; }
.arrow p { margin: 30px 60px 20px 25px; }
.arrow:after { border: 40px solid transparent; border-left: 40px solid #c97644; }
-
+
.page .wrap.with-sidebar {display:flex;}
.page .downloads {margin-left:50px;} }
-
+
/*********************
LARGE VIEWING SIZE
This is for the larger monitors and possibly full screen viewers.
*********************/
@media only screen and (min-width: 1240px) {
- #user-stories .wrap {width:1140px;}
+ #user-stories .wrap {width:1140px;}
}
/*********************
RETINA (2x RESOLUTION DEVICES)
diff --git a/library/images/architecture.png b/library/images/architecture.png
new file mode 100755
index 0000000..602045a
Binary files /dev/null and b/library/images/architecture.png differ
diff --git a/library/images/bug-1.png b/library/images/bug-1.png
new file mode 100755
index 0000000..1dd2e7a
Binary files /dev/null and b/library/images/bug-1.png differ
diff --git a/library/images/bug-2.png b/library/images/bug-2.png
new file mode 100755
index 0000000..b89eaa9
Binary files /dev/null and b/library/images/bug-2.png differ
diff --git a/library/images/bug-3.png b/library/images/bug-3.png
new file mode 100755
index 0000000..fbbeb6a
Binary files /dev/null and b/library/images/bug-3.png differ
diff --git a/library/images/bug-4.png b/library/images/bug-4.png
new file mode 100755
index 0000000..24aa945
Binary files /dev/null and b/library/images/bug-4.png differ
diff --git a/library/images/bug-5.png b/library/images/bug-5.png
new file mode 100755
index 0000000..e021006
Binary files /dev/null and b/library/images/bug-5.png differ
diff --git a/library/images/bug-6.png b/library/images/bug-6.png
new file mode 100755
index 0000000..22e80e7
Binary files /dev/null and b/library/images/bug-6.png differ
diff --git a/library/images/bug-7.png b/library/images/bug-7.png
new file mode 100755
index 0000000..49bb7fb
Binary files /dev/null and b/library/images/bug-7.png differ
diff --git a/library/images/details.png b/library/images/details.png
index 8e6c11a..d410f91 100755
Binary files a/library/images/details.png and b/library/images/details.png differ
diff --git a/library/images/details.png b/library/images/details_old.png
similarity index 100%
copy from library/images/details.png
copy to library/images/details_old.png
diff --git a/library/images/download-logo.png b/library/images/download-logo.png
new file mode 100755
index 0000000..dcf125c
Binary files /dev/null and b/library/images/download-logo.png differ
diff --git a/library/images/download.png b/library/images/download.png
new file mode 100755
index 0000000..195c8f2
Binary files /dev/null and b/library/images/download.png differ
diff --git a/library/images/network.png b/library/images/network.png
index cc2321b..2c75a38 100755
Binary files a/library/images/network.png and b/library/images/network.png differ
diff --git a/library/images/network.png b/library/images/network_old.png
similarity index 100%
copy from library/images/network.png
copy to library/images/network_old.png
diff --git a/library/images/notebook.png b/library/images/notebook.png
index 74f456d..d6de31f 100755
Binary files a/library/images/notebook.png and b/library/images/notebook.png differ
diff --git a/library/images/notebook.png b/library/images/notebook_old.png
similarity index 100%
copy from library/images/notebook.png
copy to library/images/notebook_old.png
diff --git a/library/images/service-layout-sm.png b/library/images/service-layout-sm.png
new file mode 100755
index 0000000..a63e9c9
Binary files /dev/null and b/library/images/service-layout-sm.png differ
diff --git a/library/images/service-layout.png b/library/images/service-layout.png
new file mode 100755
index 0000000..b131d5a
Binary files /dev/null and b/library/images/service-layout.png differ
diff --git a/library/images/susp-con-1.png b/library/images/susp-con-1.png
new file mode 100755
index 0000000..e7652de
Binary files /dev/null and b/library/images/susp-con-1.png differ
diff --git a/library/images/susp-con-2.png b/library/images/susp-con-2.png
new file mode 100755
index 0000000..4e37ecd
Binary files /dev/null and b/library/images/susp-con-2.png differ
diff --git a/library/images/susp-con-3.png b/library/images/susp-con-3.png
new file mode 100755
index 0000000..3026cf6
Binary files /dev/null and b/library/images/susp-con-3.png differ
diff --git a/library/images/suspicious.png b/library/images/suspicious.png
index b6714f5..a4cc311 100755
Binary files a/library/images/suspicious.png and b/library/images/suspicious.png differ
diff --git a/library/images/suspicious.png b/library/images/suspicious_old.png
similarity index 100%
copy from library/images/suspicious.png
copy to library/images/suspicious_old.png
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index cde346f..950377c 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 1047947..9e329b2 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -78,7 +78,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
@@ -101,6 +101,9 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
+ </li>
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index e93d8b4..6597b70 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
@@ -135,7 +138,7 @@
<p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection mo [...]
- <p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
+ <p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying Hadoop platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
<p>The Apache Spot ODM enables organizations to:</p>
<ul>
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
index 1d084f8..e0f9b4d 100755
--- a/project-components/suspicious-connects-analysis/index.html
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index 832e0fb..754b522 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -78,7 +78,10 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/tag/github/index.html b/tag/github/index.html
index d6a1903..af9683f 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,7 +166,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
@@ -224,4 +236,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 3fe1291..d30ec81 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,13 +166,13 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
<a href="../../blog/apache-spot-product-architecture-overview/">Apache Spot Product Architecture Overview</a>
- </li>
+ </li>
<li>
<a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
</li>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
@@ -224,4 +236,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index ad94a4b..f4080c1 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,27 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">Download</a>
+ </li>
+ <li class="menu-item menu-item-type-custom menu-item-object-custom">
+ <a href="https://github.com/apache/incubator-spot.git" target="_blank">Github</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +107,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
@@ -154,7 +166,7 @@
</main>
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
+
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
@@ -198,7 +210,7 @@
</li>
</ul>
</div>
-
+
</div>
</div>
@@ -224,4 +236,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
[incubator-spot] 32/45: Normalizing latest sections with proper
pointers, to repair broken links
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit bc57d11dd11fdfc1e794c6ac58eae13ec1ea2c60
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Wed Aug 9 00:46:01 2017 -0500
Normalizing latest sections with proper pointers, to repair broken links
---
.../architecture}/index.html | 75 ++--
.../demo}/index.html | 78 ++--
.../environment}/index.html | 83 ++--
get-started/index.html | 227 ++++++++++
.../supporting-apache}/index.html | 123 +++---
project-components/ingestion/index.html | 61 +--
project-components/machine-learning/index.html | 43 +-
project-components/open-data-models/index.html | 47 ++-
.../suspicious-connects-analysis/index.html | 464 +++++++++++++++++++++
project-components/visualization/index.html | 69 +--
10 files changed, 1003 insertions(+), 267 deletions(-)
diff --git a/project-components/machine-learning/index.html b/get-started/architecture/index.html
similarity index 70%
copy from project-components/machine-learning/index.html
copy to get-started/architecture/index.html
index 72c8d01..23ecbd6 100755
--- a/project-components/machine-learning/index.html
+++ b/get-started/architecture/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Machine Learning - Apache Spot</title>
+ <title>Architecture - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li class="active"><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -94,13 +101,15 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
- <li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -115,39 +124,21 @@
<div id="mobile-nav"></div>
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
<div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Machine Learning</h1>
-
- <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
- <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
- <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
- <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
-
- <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
- </div>
-
- </div>
-
- </div>
+ <div class="wrap cf">
+
+ <h1>Architecture</h1>
+
+ <hr />
+
+ <p class="center">
+ <img src="../../library/images/architecture.png" alt="Product Architechture" />
+ </p>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
<div id="more-info">
<div class="wrap cf">
@@ -187,4 +178,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/project-components/machine-learning/index.html b/get-started/demo/index.html
similarity index 70%
copy from project-components/machine-learning/index.html
copy to get-started/demo/index.html
index 72c8d01..f34c54c 100755
--- a/project-components/machine-learning/index.html
+++ b/get-started/demo/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Machine Learning - Apache Spot</title>
+ <title>Demo - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li class="active"><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -94,13 +101,15 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
- <li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -115,39 +124,24 @@
<div id="mobile-nav"></div>
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
<div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Machine Learning</h1>
-
- <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
- <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
- <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
- <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
-
- <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
- </div>
-
- </div>
-
- </div>
+ <div class="wrap cf">
+
+ <h1>Demo</h1>
+
+ <hr />
+
+ <ol style="margin-bottom:50px;">
+ <li><a href="https://docs.docker.com/engine/installation/" target="_blank">Install Docker</a> for your platform</li>
+ <li>Run the container: docker run -it -p 8889:8889 apachespot/spot-demo</li>
+ <li>Visit <a href="http://localhost:8889/files/ui/flow/suspicious.html#date=2016-07-08" target="_blank">http://localhost:8889/files/ui/flow/suspicious.html#date=2016-07-08</a> in your browser to get started. For the full instructions visit the <a href="https://hub.docker.com/r/apachespot/spot-demo/" target="_blank">spot</a> on Docker hub</li>
+
+ </ol>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
<div id="more-info">
<div class="wrap cf">
@@ -187,4 +181,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/project-components/machine-learning/index.html b/get-started/environment/index.html
similarity index 70%
copy from project-components/machine-learning/index.html
copy to get-started/environment/index.html
index 72c8d01..4d9e965 100755
--- a/project-components/machine-learning/index.html
+++ b/get-started/environment/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Machine Learning - Apache Spot</title>
+ <title>Environment - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li class="active"><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -94,13 +101,15 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
- <li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -115,39 +124,29 @@
<div id="mobile-nav"></div>
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
<div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Machine Learning</h1>
-
- <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
- <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
- <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
- <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
-
- <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
- </div>
-
- </div>
-
- </div>
+ <div class="wrap cf">
+
+ <h1>Environment</h1>
+
+ <hr />
+
+ <h2>Pure Hadoop</h2>
+
+ <p>Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of CDH (see diagram below).</p>
+
+ <p>This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.</p>
+
+ <p class="center"><a href="../../library/images/service-layout.png"><img src="../../library/images/service-layout-sm.png" alt="Service Layout" /></a></p>
+
+ <p>In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource manage [...]
+
+ <p>Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly.</p>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
<div id="more-info">
<div class="wrap cf">
@@ -187,4 +186,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/get-started/index.html b/get-started/index.html
new file mode 100755
index 0000000..2633e5d
--- /dev/null
+++ b/get-started/index.html
@@ -0,0 +1,227 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Get Started - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li class="active"><a href="../get-started">Get Started</a></li>
+ <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../get-started/environment">Environment</a></li>
+ <li><a href="../get-started/architecture">Architecture</a></li>
+ <li><a href="../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../community/committers">Project Committers</a></li>
+ <li><a href="../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+
+ <h1>Getting Started</h1>
+ <hr />
+ <h2>Apache Spot (Incubating)</h2>
+
+ <p>Apache Spot is open source software for leveraging insights from flow and packet analysis. It helps enterprises and service providers gain insight on their network environments through transparency of service delivery and identification of potential security threats or attacks happening among resources operating at cloud scale. While current threat intelligence tools help, identifying unknown threats and attacks remains a challenge. Apache Spot provides tools to accele [...]
+
+ <p>Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.</p>
+
+ <h2>Overview</h2>
+
+ <p>With the arrival of big data platforms, security organizations can now make data-driven decisions about how they protect their assets. Records of network traffic, captured as network flows, are often stored and analyzed for use in network management. An organization can use this same information to gain insight into what channels corporate information flows through.</p>
+
+ <p>By taking into account additional context such as prevalent attacks and key protocols to the organization, the security team can develop a strategy that applies the right amount of per-channel risk mitigation based on the value of the data flowing through it. For an organization, we call this "the port perspective".</p>
+
+ <p>There are two vectors that all organizations should evaluate:</p>
+
+ <ul>
+ <li>A "wide enough, deep enough" protection strategy that involves both edge prevention and sophisticated detection of unusual behavior</li>
+ <li>A deep inspection of key protocols using methods that can scale to the volume of data flowing across that channel</li>
+ </ul>
+
+ <p>While inspecting specific, unique flows of data that may be important for individual organizations, all organizations can realize significant risk reduction from analysis of network flows and DNS (domain name service) replies.</p>
+
+ <p>Apache Spot by leveraging strong technology in both Big Data and Scientific Computing disciplines is a solution intended to support this strategy by focusing on “hard security problems” detecting events such as lateral movement, side-channel data escapes, insider issues, or stealthy behavior in general.</p>
+
+ <p style="text-align:center;margin:35px 0;"><img src="../library/images/how-it-works.png" alt="" /></p>
+
+ <h3>Telemetry</h3>
+ <ul>
+ <li>Flows.</li>
+ <li>DNS (pcaps).</li>
+ <li>Proxy.</li>
+ </ul>
+
+ <h3>Parallel Ingest Framework</h3>
+ <ul>
+ <li>Open source decoders.</li>
+ <li>Load data in Hadoop.</li>
+ <li>Data transformation.</li>
+ </ul>
+
+ <h3>Machine Learning</h3>
+ <ul>
+ <li>Filter billion of events to a few thousands.</li>
+ <li>Unsupervised learning.</li>
+ </ul>
+
+ <h3>Operational Analytics</h3>
+ <ul style="margin-bottom:50px;">
+ <li>Visualization.</li>
+ <li>Attack heuristics.</li>
+ <li>Noise filter.</li>
+ </ul>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/project-components/open-data-models/index.html b/get-started/supporting-apache/index.html
similarity index 61%
copy from project-components/open-data-models/index.html
copy to get-started/supporting-apache/index.html
index 7c4ac19..5ca3f2d 100755
--- a/project-components/open-data-models/index.html
+++ b/get-started/supporting-apache/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Open Data Models - Apache Spot</title>
+ <title>Supporting Apache - Apache Spot</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li class="active"><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -94,13 +101,15 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a href="../../doc">Documentation</a>
</li>
- <li class="menu-item menu-item-has-children active">
+ <li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li class="active"><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -113,46 +122,64 @@
</header>
- <div id="mobile-nav"></div>
+ <div id="mobile-nav"></div>
-
<div id="content">
-
- <div class="wrap cf with-sidebar"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Open Data Model</h1>
-
- <p>Many organizations have built threat detection capabilities leveraging myriad vendor solutions. This approach leads to many silos of data corresponding to each vendor and often results in storing multiple copies of the same data, as each vendor’s capability operates independently from the others. There is no single vendor able to cost-effectively store and analyze all the data required to detect threats and facilitate incident investigations and remediation.</p>
-
- <p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection mo [...]
-
- <p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
-
- <p>The Apache Spot ODM enables organizations to:</p>
- <ul>
- <li>Store one copy of the security telemetry data and apply UNLIMITED analytics
- <ul>
- <li>Leverage out-of-the-box analytics powered by machine learning to detect threats in DNS, Flow and Proxy data</li>
- <li>Build custom analytics to your desired specification</li>
- <li>Plug-in third-party vendor analytics that interoperate with the ODM</li>
- </ul>
- </li>
- <li>Share and/or reuse threat detection models, algorithms, ingest pipelines, visualizations and analytics across the Apache Spot community, due to a common data model.</li>
- <li>Leverage all your security telemetry data to establish the context needed to better detect threats
- <ul>
- <li>Security logs</li>
- <li>User, endpoint and network entity data</li>
- <li>Threat intelligence data</li>
- </ul>
- </li>
- <li>Avoid “lock-in” to a specific technology and gain needed analytic flexibility resultant from a shared, open data model.</li>
- </ul>
- </div>
-
-
- </div>
-
- </div>
+
+ <div class="wrap cf">
+
+ <h1>Supporting Apache</h1>
+ <hr />
+ <p>Apache Spot functionality is divided into different modules, go to each module for developer documentation:</p>
+ <ul>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-ingest/README.md" target="_blank">spot-ingest</a></li>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/README.md" target="_blank">spot-ml</a></li>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md" target="_blank">spot-oa</a></li>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-setup/README.md" target="_blank">spot-setup</a></li>
+ </ul>
+
+ <h2>Community Support</h2>
+ <p>Our Central repository for our Apache Spot solution is found here. If you find a bug, have question or something to discuss please contact us:</p>
+ <ul>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT-20?jql=project%20%3D%20SPOT" target="_blank">Create an Issue.</a></li>
+ <li>Community Access.</li>
+ </ul>
+
+ <h2>Contributing to Apache Spot</h2>
+ <p>Help us improve Apache Spot!</p>
+ <p>Apache Spot is Apache 2.0 licensed and accepts contributions via GitHub pull requests. Please follow the next steps and join our community. Disconnected</p>
+ <ul>
+ <li>Create an Issue.</li>
+ <li>Community Access.</li>
+ </ul>
+
+ <h2>Contributing to Apache Spot code</h2>
+
+ <ul>
+ <li>Fork the repo of the module that you wish to commit to.</li>
+ <li>Create a Branch, we use <a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">topic branches</a> for our commits.</li>
+ <li>Push your commit(s) to your repository.</li>
+ <li>Create a pull request to the original repo in Apache Spot organization.</li>
+ </ul>
+
+ <h2>Commit Guidelines</h2>
+ <ul>
+ <li>Bug fixes should be a single commit.</li>
+ <li>Please be clear with the commit messages about what you are fixing or adding to the code base. If you code is addressing an open issue please add the reference to the issue in the comments with: Fix: Issue's URL.</li>
+ </ul>
+
+ <h2>Merge approval</h2>
+ <p>Apache Spot maintainers use +1 in a comment on the code review to indicate acceptance, at least 3 "+1" from maintainers are required to approve the merge. If you have any question or concern please feel free to add a comment in your pull request or branch and tag any of the maintainers.</p>
+
+ <h2>Licensing</h2>
+ <p>Apache Spot is licensed under the Apache License, Version 2.0. See <a href="https://github.com/apache/incubator-spot/blob/master/LICENSE" target="_blank">LICENSE</a> for the full license text.</p>
+ <ul style="margin-bottom:50px;">
+ <li>spot-nfdump <a href="https://github.com/Open-Network-Insight/spot-nfdump/blob/master/BSD-license.txt" target="_blank">License</a></li>
+ </ul>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
<div id="more-info">
<div class="wrap cf">
@@ -192,4 +219,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 6949f4c..cde346f 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li class="active"><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -124,50 +133,50 @@
</div>
</div>-->
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Apache Spot Ingestion</h1>
-
+
<p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the dat [...]
-
+
<p><img src="../../library/images/ingestion.png" alt="" /></p>
-
+
<h3>Inside the Ingest</h3>
-
+
<h4><em>Spot-Collectors</em></h4>
-
+
<p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
-
+
<p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
<p>Once a file has been uploaded there two paths are available.</p>
-
+
<ol>
<li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
<li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
</ol>
-
+
<h4><em>Kafka</em></h4>
-
+
<p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
-
+
<h4><em>Spot Workers</em></h4>
-
+
<p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
-
+
<p>Currently there are two types of Spot Workers.</p>
-
+
<ol>
<li>Python workers use multithreading to process data with the defined parsers.</li>
<li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
- </ol>
-
+ </ol>
+
</div>
</div>
-
+
</div>
@@ -209,4 +218,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 72c8d01..1047947 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -124,28 +133,26 @@
</div>
</div>-->
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Apache Spot Machine Learning</h1>
-
+
<p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
+
<p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
+
<p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
+
<p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
<p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
</div>
-
+
</div>
-
+
</div>
@@ -187,4 +194,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 7c4ac19..e93d8b4 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li class="active"><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li class="active"><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -115,19 +124,19 @@
<div id="mobile-nav"></div>
-
+
<div id="content">
-
+
<div class="wrap cf with-sidebar"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Apache Spot Open Data Model</h1>
-
+
<p>Many organizations have built threat detection capabilities leveraging myriad vendor solutions. This approach leads to many silos of data corresponding to each vendor and often results in storing multiple copies of the same data, as each vendor’s capability operates independently from the others. There is no single vendor able to cost-effectively store and analyze all the data required to detect threats and facilitate incident investigations and remediation.</p>
-
+
<p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection mo [...]
-
+
<p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
-
+
<p>The Apache Spot ODM enables organizations to:</p>
<ul>
<li>Store one copy of the security telemetry data and apply UNLIMITED analytics
@@ -135,7 +144,7 @@
<li>Leverage out-of-the-box analytics powered by machine learning to detect threats in DNS, Flow and Proxy data</li>
<li>Build custom analytics to your desired specification</li>
<li>Plug-in third-party vendor analytics that interoperate with the ODM</li>
- </ul>
+ </ul>
</li>
<li>Share and/or reuse threat detection models, algorithms, ingest pipelines, visualizations and analytics across the Apache Spot community, due to a common data model.</li>
<li>Leverage all your security telemetry data to establish the context needed to better detect threats
@@ -143,15 +152,15 @@
<li>Security logs</li>
<li>User, endpoint and network entity data</li>
<li>Threat intelligence data</li>
- </ul>
+ </ul>
</li>
<li>Avoid “lock-in” to a specific technology and gain needed analytic flexibility resultant from a shared, open data model.</li>
</ul>
</div>
-
-
+
+
</div>
-
+
</div>
<div id="more-info">
@@ -192,4 +201,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
new file mode 100755
index 0000000..1d084f8
--- /dev/null
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -0,0 +1,464 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Suspicious Connects Analysis - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children active">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li class="active"><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Supsicious Connects Analysis</h1>
+
+ <p>Spot offers a family of suspicious connections analyses that identify the most suspicious or unlikely network events in the observed network and report these to the user for further investigation to determine if they are indicative of maliciousness or malfunction. The suspicious connects analysis is a form of semi-supervised anomaly detection that uses topic modelling to infer common network behaviors and build a model of behavior for each IP address. </p>
+
+ <p>The topic model at the core of Spot-ml is an unsupervised machine learning model. However, Spot allows for user feedback to effect the model’s view of what is suspicious (see ‘Further Notes on Spot-ml’ for more details about the feedback functionality). This section briefly describes the mathematical principles behind the Suspicious Connects Analysis.</p>
+
+ <h3>Supported Data for Analyses</h3>
+ <p>Currently Spot supports analyses on the following data sources:</p>
+
+ <ul>
+ <li>(undirected) Netflow logs</li>
+ <li>DNS logs</li>
+ <li>HTTP Proxy logs</li>
+ </ul>
+
+ <p>In this discussion, log entries are referred to as "network events".</p>
+
+ <h3>Anomaly Detection via Topic Modelling</h3>
+
+ <p>The suspicious connects analysis infers a probabilistic model for the network behaviors of each IP address. Each network event is assigned an estimated probability (henceforth, the event’s “score”). Those events with the lower scores are flagged as “suspicious” for further analysis.</p>
+
+ <p>The probabilistic model is generated via topic modelling. Topic modelling is a technique from natural language processing that analyzes a collection of natural language documents, and infers the topics discussed by the documents. In particular we use a latent Dirichlet allocation (LDA) model. For details outside of the scope of this description, please see the Journal of Machine Learning Research article “Latent Dirichlet Allocation” by David M. Blei, Andrew Y. Ng, a [...]
+
+ <p>Below we describe the probability distributions that arise from an LDA model, and describe how anomaly scores can be assigned to words of a document. We then describe how ‘words’ and ‘documents’ are formed from network logs so that a network log entry is provided an anomaly score given by the score of the word to which it is associated. </p>
+
+ <h3>Latent Dirichlet Allocation</h3>
+
+ <p>Input: A collection of documents, each viewed as a multiset of words (bag of words). An integer k which is the number of latent topics for the model to learn.</p>
+
+ <p>Output: Two families of distributions. For each document, a “document’s topic mix” which gives the probability that a word selected at random from the document belongs to any given topic (that is, the fraction of that document dedicated to any given topic). For each topic, a “topic’s word mix” which gives the probability of any given word conditioned on the topic (that is, the fraction of that topic dedicated to each word).</p>
+
+ <p>In mathematical notation:</p>
+
+ <img src="../../library/images/susp-con-1.png" alt="" />
+
+ <p>An assumption is made that a topic’s word mix is independent of the document in question. We can therefore perform a model-estimate of the probability of a word, w, appearing in the document, d, as follows:</p>
+
+ <img src="../../library/images/susp-con-2.png" alt="" />
+
+ <h3>Topic Modelling and Network Events</h3>
+ <p>By viewing the logged behavior of an IP address as a document (eg. all DNS queries of a particular client IP) and the constituent log entries as “words” it is straightforward to apply topic modelling to analyze network traffic.</p>
+
+ <table class="cont-table">
+ <tr>
+ <td>Text Corpora</td>
+ <td>Network Logs</td>
+ </tr>
+
+ <tr>
+ <td>document</td>
+ <td>log records of a particular IP adddress</td>
+ </tr>
+
+ <tr>
+ <td>word</td>
+ <td>(simplified) log entry</td>
+ </tr>
+
+ <tr>
+ <td>topic</td>
+ <td>profile of common network behavior</td>
+ </tr>
+ </table>
+
+ <p>There is one significant wrinkle: For topic modelling to provide interesting results, there should be significant overlap in the words used by different documents, whereas network log entries contain nearly unique identifiers such as network addresses and timestamps. For this reason, to perform topic modelling on network events, the log entries must be simplified into words.</p>
+
+ <h3>From Events to Documents: Word Creation</h3>
+
+ <p>The conversion of network events into words is the point of subtle art in the Spot Suspicious Connects analysis. The procedure for converting events into words must preserve enough information to turn up interesting anomalies during malicious behavior or malfunction, it must create words with enough overlap between documents (IP addresses) that the topic modelling step produces meaningful results, and it should distill information that is particular to the “type” of [...]
+
+ <h3>Netflow</h3>
+
+ <p>A netflow record is simplified into two separate words, one to be inserted in the document associated to the source IP and another (possibly different word) inserted into the document associated to the destination IP. The words are created as follows:</p>
+
+
+ <table class="cont-table">
+ <tr>
+ <td>Feature (string 'letter in the word')</td>
+ </tr>
+
+ <tr>
+ <td>
+ <p>Flow Direction:</p>
+
+ <p>If both ports (between source and destination) are 0, then this feature is missing from the words that go into both the source and destination IP documents.</p>
+
+ <p>If exactly one port is 0, this feature is missing for the IP document associated to the 0 port, and this feature is given as “-1” for the IP document associated to the non-zero port.</p>
+
+ <p>If neither port is zero, and either both or neither of the listed ports are strictly less than 1025, this feature is missing for both source IP and destination IP words.</p>
+
+ <p>If neither port is zero and only one of the ports is strictly less than 1025, this feature is given as “-1” for the IP document associated with port that is less than 1025 and is missing for the IP document associated to the other (high) port.</p>
+ </td>
+ </tr>
+
+
+ <tr>
+ <td>
+ <p>Key Port:<br />If both source and destination ports are 0 this feature is given as “0” for both source and destination IP documents.</p>
+
+ <p>If exactly one of the ports is non-zero this feature is given as the non-zero port number for both source and destination IP documents.</p>
+
+ <p>If exactly one port is less than 1025 and this port is not zero, this feature is given as this port number for both the source and destination IP documents.</p>
+
+ <p>If both ports are non-zero and strictly less than 1025 this feature is given as “111111” for both the source and destination IP documents.</p>
+
+ <p>If both ports are greater than or equal to 1025 this feature is given as “333333” for both the source and destination IP documents.</p>
+ </td>
+ </tr>
+
+ <tr>
+ <td>
+ <p>Protocol<br />Use the string as given in log entry</p>
+ </td>
+ </tr>
+
+ <tr>
+ <td>
+ <p>Time of day<br />Use the hour portion of the time stamp</p>
+ </td>
+ </tr>
+
+ <tr>
+ <td>
+ <p>Total Bytes<br />Use the string for the bin number into which the frame length falls, using bins defined by the following cutoff values: <br />
+ (0, 1, 2, 4, 8, …)</p>
+ </td>
+ </tr>
+
+ <tr>
+ <td>
+ <p>Number of Packets<br />
+ Use the string for the bin number into which the frame length falls, using bins defined by the following cutoff values: <br />
+ (0, 1, 2, 4, 8, …)</p>
+
+ </td>
+ </tr>
+ </table>
+
+ <p>Examples:<br />
+ (1) A record with source port 1066, destination port 301, protocol given as TCP, time of day with hour equal to 3, bytes transferred equal to 1026, with 10 packets sent. <br />
+ The word “301_TCP_3_12_5” is created for the source IP document.<br />
+ The word: “-1_301_TCP_3_12_5” is created for the destination IP document .</p>
+
+ <p>(2) A record with source port 1194, destination port 1109, protocol given as UDP, time of day with hour equal to 7, bytes transferred equal to 1026, and 1 packet sent.<br />
+ The word: “333333_UDP_7_12_1” is created for both the source and destination IP documents</p>
+
+ <h3>DNS</h3>
+
+ <p>A DNS log entry is simplified into a word and inserted into the document associated to the client IP making the DNS query. The word is created as follows:</p>
+
+ <table class="cont-table">
+ <tr>
+ <td><p>Feature(string ‘letter in the word’)</p></td>
+ </tr>
+ <tr>
+ <td><p>Analyze DNS query name:<br />
+ If belongs to Alexa top 1 million list, use “1”<br />
+ If belongs to user domain, use “2”<br />
+ (Note: For it.intel.com the domain is ‘intel’)<br />
+ Otherwise, use “0”</p>
+ </td>
+ </tr>
+ <tr>
+ <td><p>Frame length<br />
+ Use the string for the bin number into which the frame length falls, using bins defined by the following cutoff values:<br />
+ (0, 1, 2, 4, 8, …)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Time of day<br />
+ Use the hour portion of the time stamp</p>
+ </td>
+ </tr>
+ <tr>
+ <td><p>Subdomain Length<br />
+ Use the string for the bin number into which the frame length falls, using bins defined by the following cutoff values: <br />
+ (0, 1, 2, 4, 8, …)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>String Entropy of Subdomain<br />
+ Use the string for the bin number into which the frame length falls, using bins defined by the following cutoff values: <br />
+ (0.0, 0.3, 0.6, 0.9, 1.2, 1.5, 1.8, 2.1, 2.4, 2.7, 3.0, 3.3,
+ 3.6, 3.9, 4.2, 4.5, 4.8, 5.1, 5.4, 20)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Number of periods in Subdomain<br />
+ Use the string for the bin number into which the frame length falls, using bins defined by the following cutoff values: <br />
+ (0, 1, 2, 4, 8, …)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>DNS query type<br />
+ Use the string as given in the log entry</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>DNS query response code<br />
+ Use the string as given in the log entry</p>
+ </td>
+ </tr>
+ </table>
+
+ <h3>Proxy</h3>
+ <p>A proxy log entry is simplified into a word and inserted into the document associated to the client IP making the proxy request. The word is created as follows:</p>
+
+ <table class="cont-table">
+ <tr>
+ <td>
+ <p>Feature(string ‘letter in the word’)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Analyze DNS query name:<br />
+ If belongs to Alexa top 1 million list, use “1”<br />
+ If belongs to user domain, use “2”<br />
+ (Note: For it.intel.com the domain is ‘intel’)<br />
+ Otherwise, use “0” </p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Time of day<br />
+ Use the hour part of the time stamp</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Request Method<br />
+ Use the string as given in the log entry (eg. “Get”, “Post”, etc.)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ String Entropy of URI
+ Use the string for the bin number (0-18) into which the entropy<br />
+ value falls, using bins defined by the following cutoff values:<br />
+ (0.0, 0.3, 0.6, 0.9, 1.2, 1.5, 1.8, 2.1, 2.4, 2.7, 3.0, 3.3, 3.6, 3.9, 4.2, 4.5, 4.8, 5.1, 5.4, 20)
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Top level content type<br />
+ Use the string as given in the log entry (eg. “image”, “binary”)</p>
+ </td>
+ </tr>
+ <tr>
+ <td><p>Frequency of user agent type in training data<br>
+ Use the string for the bin number (0-∞) into which the entropy value falls, using bins defined by the following cutoff values:<br />(0, 1, 2, 4, 8, 16, 32, …)</p>
+ </td>
+ </tr>
+ <tr>
+ <td>
+ <p>Response code<br />
+ Use string as given in the log entry</p>
+ </td>
+ </tr>
+ </table>
+
+ <h3>Further Notes on Spot-ml</h3>
+
+ <ul>
+ <li>
+ <h4>Notes on the binning for word creation</h4>
+ <p>The bin number associated to a given value is assigned as the index of the first entry in the array of cut off values for which the value is less than or equal to that entry. For example the values that will fall into bin number 0 are defined by the inequality: value <= cut_off_array(0) and the values that lie in bin number 1 are defined by the inequality: cut_off_array(0) < value <= cut_off_array(1).</p>
+ </li>
+
+ <li>
+ <h4>LDA Implementation</h4>
+ <p>We currently use a Spark-MLlib implementation of latent Dirichlet allocation.</p>
+ </li>
+
+ <li>
+ <h4>User Feedback</h4>
+ <p>If the user determines that certain feature values of a connection are acceptable and have been wrongly classified, Spot allows the user to provide feedback in order that a new model can be generated that will no longer flag similar events as suspicious.</p>
+
+ <p>In the UI, the user can designate a selection of features out of: source ip, destination ip, source port, and destination port; to be given a user-severity score of ‘3’ (meaning low priority). This action causes low priority designations to be associated to all of the log entries (from within the collection of the most suspicious entries that were returned from Spot-ml) that have feature values matching the features selected. These log entries are then stored int [...]
+ </li>
+ </ul>
+
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index a42f08c..832e0fb 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li class="active"><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -115,58 +124,58 @@
<div id="mobile-nav"></div>
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Visualization</h1>
<h3>Take advantage of Apache Spot's tools to perform further analysis over the suspicious activity detected by our machine learning algorithm</h3>
-
+
<h4>Suspicious</h4>
-
+
<p>Study <strong>suspicious</strong> network activity by looking at a list of security threats detected by Apache Spot's machine learning algorithm.</p>
-
+
<p><img src="../../library/images/suspicious.png" alt="" /></p>
-
+
<p>Have a nice view of your network, understand how devices interact with each other and easily spot threats while exploring a visual representation of suspicious activity.</p>
-
+
<p><img src="../../library/images/network.png" alt="" /></p>
-
+
<p>The following feature is powered by IPython notebooks which allows the users to switch back and forth from the 'easy mode' to the 'expert mode', where they can view and edit the code behind this panel via the web browser.</p>
-
+
<p>In the 'Notebook' panel, the form displayed is where the user can assign the level of risk for each connection and use that as feedback to train the Machine Learning model in future executions. Switching to the 'expert' mode, the user can adjust the criteria to filter the data, discarding results known to be non relevant to the analysis.</p>
-
+
<p><img src="../../library/images/notebook.png" alt="" /></p>
-
+
<p>As your investigation moves forward, get <strong>detailed</strong> information about a threat whenever you want to dig into an especific threat.</p>
-
+
<p><img src="../../library/images/details.png" alt="" /></p>
-
+
<h4>Threat Investigation</h4>
-
+
<p>The threat investigation panel represents the last step of analysis before displaying the storyboard. At this point, the security analysts can enter a custom review for a given threat to display.</p>
-
+
<h4>Storyboard</h4>
-
+
<p>Ready to present your findings? Go over your high risk security threats and request further information, making it easy for executives to undestand what is going on. Here is a list of some of the information you will get when your analyses comes to the end.</p>
-
+
<ul>
<li>Incident Progression</li>
<li>Impact Analysis</li>
<li>Geographic location</li>
<li>Incident Timeline</li>
</ul>
-
+
<h4>Ingest Summary</h4>
-
+
<p>Wondering about how much data have been ingested on your cluster? We provide a nice visualization which allows you to get this information.</p>
-
+
<p><img src="../../library/images/ingest-summary.png" alt="" /></p>
-
+
<p>The "scoring panel" as well as the "Threat investigation panel" are powered by Jupyter notebooks, <a href="https://jupyter-notebook-beginner-guide.readthedocs.io/en/latest/what_is_jupyter.html" target="_blank">(click here to learn more)</a>.</p>
</div>
-
+
</div>
-
+
</div>
@@ -208,4 +217,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
[incubator-spot] 12/45: Merge branch 'asf-site' of
https://git-wip-us.apache.org/repos/asf/incubator-spot into asf-site
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit f90eb5515fb3feaa591d1205112adcdc1c38f29f
Merge: 4fb7359 4d87f03
Author: cesar <ce...@apache.org>
AuthorDate: Tue Oct 18 18:12:18 2016 -0500
Merge branch 'asf-site' of https://git-wip-us.apache.org/repos/asf/incubator-spot into asf-site
Reflect changes on WP Template and correct branding usage, Apache Spot
(Incubating).
.../index.html | 14 +++++-----
.../index.html | 22 +++++++--------
.../index.html | 32 +++++++++++-----------
3 files changed, 34 insertions(+), 34 deletions(-)
[incubator-spot] 30/45: Update to Spot website removing any Third
Party logos per ASF Marketing policies
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit c48cb75f28ee5c316d3061731cc365f50ba6ca14
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Wed Aug 9 00:18:00 2017 -0500
Update to Spot website removing any Third Party logos per ASF Marketing policies
---
.DS_Store | Bin 10244 -> 12292 bytes
community/committers/index.html | 100 +++++++++++++++++++++++------
community/contribute/index.html | 137 +++++++++++++++++++++++++++++-----------
community/index.html | 35 ++++++----
index.html | 62 ++++++++++--------
5 files changed, 239 insertions(+), 95 deletions(-)
diff --git a/.DS_Store b/.DS_Store
index 8dcc55c..ee7f6e6 100644
Binary files a/.DS_Store and b/.DS_Store differ
diff --git a/community/committers/index.html b/community/committers/index.html
index cf1d062..094744e 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,21 +67,28 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
- </li>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a href="../../download">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
- <li><a href="../../community/committers">Project Committers</a></li>
- <li class="active"><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="active"><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
<li class="divider"></li>
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -114,145 +123,198 @@
</header>
<div id="mobile-nav"></div>
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1>Apache Spot Committers</h1>
- <p>Following is a list of current Spot committers.</p>
-
+ <p>Following is a list of current Spot committers.</p>
+
<div class="divTable" style="width: 100%;">
<div class="divTableBody">
<div class="divTableRow tableHeading">
<div class="divTableCell">Username</div>
<div class="divTableCell">Name</div>
+ <div class="divTableCell">Company</div>
<div class="divTableCell">Role</div>
</div>
<div class="divTableRow">
<div class="divTableCell">jarcec</div>
<div class="divTableCell">Jarek Jarcec Cecho</div>
+ <div class="divTableCell">StreamSets</div>
<div class="divTableCell">Mentor</div>
</div>
<div class="divTableRow">
<div class="divTableCell">brock</div>
<div class="divTableCell">Brock Noland</div>
+ <div class="divTableCell">StreamSets</div>
<div class="divTableCell">Mentor</div>
</div>
<div class="divTableRow">
<div class="divTableCell">asavu</div>
<div class="divTableCell">Andrei Savu</div>
+ <div class="divTableCell">Cloudera</div>
<div class="divTableCell">Mentor</div>
</div>
<div class="divTableRow">
<div class="divTableCell">umamahesh</div>
<div class="divTableCell">Uma Maheswara Rao G</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">Mentor</div>
</div>
-
+
<div class="divTableRow">
<div class="divTableCell">rabarona</div>
<div class="divTableCell">Ricardo Barona</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">cesar</div>
<div class="divTableCell">Cesar Berho</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">vganji</div>
<div class="divTableCell">Sai Ganji</div>
+ <div class="divTableCell">Cloudwick</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">ledagl</div>
<div class="divTableCell">Leda Gabriela Lima Garza</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">vgonzale</div>
<div class="divTableCell">Victor Gonzalez</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">mark</div>
<div class="divTableCell">Mark Grover</div>
+ <div class="divTableCell">Cloudera</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell"></div>
<div class="divTableCell">Morris Hicks</div>
+ <div class="divTableCell">Cloudera</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">leahy</div>
<div class="divTableCell">Austin Leahy</div>
+ <div class="divTableCell">Dataminion</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">ashrith</div>
<div class="divTableCell">Ashrith Mekala</div>
+ <div class="divTableCell">Cloudwick</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">daortizh</div>
<div class="divTableCell">Diego Ortiz</div>
+ <div class="divTableCell">AWS</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">sudarshan.rao.p</div>
<div class="divTableCell">Sudharshan Rao PakalaSai</div>
+ <div class="divTableCell">Cloudwick</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">vsr</div>
<div class="divTableCell">Srinivasa Reddy</div>
+ <div class="divTableCell">Cloudwick</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">alan</div>
<div class="divTableCell">Alan Ross</div>
+ <div class="divTableCell">Cybraics</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">everlosa</div>
<div class="divTableCell">Everardo Lopez Sandoval</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell"></div>
<div class="divTableCell">Nathan Segerlind</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">solrac901</div>
<div class="divTableCell">Carlos Villavicencio</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">zrlram</div>
<div class="divTableCell">Raffael Marty</div>
+ <div class="divTableCell">Sophos</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">nathanael</div>
<div class="divTableCell">Nathanael Smith</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
<div class="divTableRow">
<div class="divTableCell">moyete</div>
<div class="divTableCell">Moises Valdovinos</div>
+ <div class="divTableCell">Intel</div>
<div class="divTableCell">PPMC</div>
</div>
-
+ <div class="divTableRow">
+ <div class="divTableCell">raypanduro</div>
+ <div class="divTableCell">Raymundo Panduro</div>
+ <div class="divTableCell"></div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell"></div>
+ <div class="divTableCell">Marilia Valdovinos</div>
+ <div class="divTableCell">Semantix</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell"></div>
+ <div class="divTableCell">Felipe Ruiz</div>
+ <div class="divTableCell">Semantix</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell"></div>
+ <div class="divTableCell">Brandon Edwards</div>
+ <div class="divTableCell">Intel</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
+ <div class="divTableRow">
+ <div class="divTableCell"></div>
+ <div class="divTableCell">Gustavo Lujan</div>
+ <div class="divTableCell">Intel</div>
+ <div class="divTableCell">PPMC</div>
+ </div>
</div>
</div>
-
+
</div>
</div>
-
+
</div>
@@ -294,4 +356,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index da80d18..ddb5eda 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
- </li>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a href="../../download">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -114,25 +123,23 @@
</header>
<div id="mobile-nav"></div>
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Proposed Apache-Spot (incubating) Commit Workflow</h1>
-
+
<p><strong>NOTE: Most of this guide is based on ASF Documentation.</strong></p>
-
- <p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.</p>
-
- <p>Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
-
+
+ <p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
+
<h3 class="center" style="margin-top:35px;">Individual Push (most commonly used by the community):</h3>
-
+
<p><img src="../../library/images/individual-push.png" alt="" /></p>
-
+
<p><strong>Steps:</strong></p>
-
+
<ol>
<li>For the Github repository at <a href="https://github.com/apache/incubator-spot" target="_blank">https://github.com/apache/incubator-spot</a> if you haven't already. For more information about Fork please go to: <a href="https://help.github.com/articles/fork-a-repo/" target="_blank">https://help.github.com/articles/fork-a-repo/</a></li>
<li>Clone your fork, create a new branch named after a Jira issue (i.e. <strong>spot-100</strong>).</li>
@@ -141,43 +148,97 @@
<li>Create a pull request (PR) against the upstream repo (master) of apache-spot. For more information about how to create a pull request please go to: <a href="https://help.github.com/articles/about-pull-requests/" target="_blank">https://help.github.com/articles/about-pull-requests/</a>.</li>
<li>Wait for the maintainers to review your PR.</li>
</ol>
-
+
<h3 class="center" style="margin-top:35px;">Topic Branching (upstream)</h3>
-
+
<p>What are a topic branches?</p>
-
+
<blockquote>According to the git definition: "<em>A topic branch is a short-lived branch that you create and use for a single particular feature or related work.</em>" (<a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches</a>)</blockquote>
-
+
<p>Sometimes a new major feature will have dependencies between modules or developers that can't be separated into individual pushes, when this happens, a topic branch will be created to deliver the complete functionality before the merge with the upstream (encapsulated dev enviroment).</p>
-
+
<p>In order to create a topic branch, three requirements are needed:</p>
-
+
<ol>
<li>A design document must be uploaded using Jira. This design must be approved by the maintainers.</li>
<li>A voting process will be required to approve the topic branch creation, at least 3 maintainers need to approve it.</li>
<li>A commitment to delete the branch after merging it into the upstream branch must be done. The topic branch should only exist while the work is still in progress.</li>
</ol>
-
+
<p>A meaningful name must be given to the branch. It is recommended to use JIRA issue created with the design document to link the branch.</p>
-
+
<p><img src="../../library/images/topic-branching.png" alt="" /></p>
-
+
<p><strong>IMPORTANT: There shouldn't be a push without a Jira created previously</strong></p>
-
+
<h3>Approvals and Voting Process:</h3>
-
+
<blockquote>
- <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
-
+ <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
+
<p>Unless a vote has been declared as using <u>lazy consensus</u>, three +1 votes are required for a code-modification proposal to pass.</p>
-
+
<p>Whole numbers are recommended for this type of vote, as the opinion being expressed is Boolean: 'I approve/do not approve of this change.'</p>
-
+
<p><strong>Source: <a href="http://apache.org/foundation/voting.html" target="_blank">http://apache.org/foundation/voting.html</a></strong></p>
</blockquote>
-
+
+ <h2>Bug Process Creation for Apache Spot (Incubator) Project in Jira</h2>
+
+ <p><strong>How to guide to open bugs:</strong> the following guide is intended for any contributor working with the Apache Spot (Incubator) project that needs to create a bug in Jira.</p>
+
+ <h3 class="green">Creating a bug in ASF Jira for Spot (Incubating) project.</h3>
+
+ <p>To create bugs for Apache Spot (Incubator) in Jira use the following link: <a href="https://issues.apache.org/jira/secure/Dashboard.jspa" target="_blank">https://issues.apache.org/jira/secure/Dashboard.jspa</a></p>
+
+ <p>It is required to have an active account to create bugs. An account can be created using the Sign Up link below the login form.</p>
+
+ <p class="center"><img src="../../library/images/bug-1.png" alt="" /></p>
+
+ <p>Once an account has be created and logged into Jira a Create button in RED will be displayed. Click the Create Button to open a new bug:</p>
+
+ <p class="center"><img src="../../library/images/bug-2.png" alt="" /></p>
+
+ <p>A template window will show up, make sure to select Spot for the Project field and select the Bug value for Issue Type field.</p>
+
+ <p class="center"><img src="../../library/images/bug-3.png" alt="" /></p>
+
+ <p>For summary, we recommend using the following naming convection: [Component][Pipeline]: "Bug Description"</p>
+
+ <p><strong>E.g.</strong>: [Ingest][Flow]: Ingest not ingesting data from defined path on Hadoop.</p>
+
+ <p>Priority: Please select "Triage" on the bug priority so the apache spot committee can review and analyze the bug to define the best priority based on the information of the bug.</p>
+
+ <p>Components: Ingest, Machine Learning, Operational Analytics, User Interface.</p>
+
+ <p>Affects Version: The branch you installed on your environment.</p>
+
+ <p>Environment: Please describe the environment you currently have where you installed apache spot. This includes, OS Version, Hadoop Version, No. of nodes., under what node you have installed, Ingest, Machine Learning, Operational Analytics/UI.</p>
+
+ <p class="center"><img src="../../library/images/bug-4.png" alt="" /></p>
+
+ <p>Description: Please use the following template to describe your problem:</p>
+
+ <p>
+ Steps to reproduce the bug:<br />
+ Actual Results:<br />
+ Expected Results:
+ </p>
+
+ <p class="center"><img src="../../library/images/bug-5.png" alt="" /></p>
+
+ <p><strong>Attachments:</strong> Please upload screenshots and logs of your findings that will be useful to debug the problem.</p>
+
+ <p class="center"><img src="../../library/images/bug-6.png" alt="" /></p>
+
+ <p>Leave the rest of the fields as default and click the Create button.</p>
+
+ <p class="center"><img src="../../library/images/bug-7.png" alt="" /></p>
+
+ <p>The Apache Spot (Incubator) team will review all bugs that are new and in triage state to define a priority to make a fix giving a first update in the bug adding a comment regarding the problem or in case asking for more evidence and information to determine the problem.</p>
+
<h3>Useful links:</h3>
-
+
<ul>
<li><a href="https://www.apache.org/foundation/glossary.html" target="_blank">https://www.apache.org/foundation/glossary.html</a></li>
<li><a href="http://www.apache.org/dev/committers" target="_blank">http://www.apache.org/dev/committers</a></li>
@@ -186,7 +247,7 @@
</ul>
</div>
</div>
-
+
</div>
@@ -228,4 +289,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
diff --git a/community/index.html b/community/index.html
index 0ecb6e7..b68c205 100755
--- a/community/index.html
+++ b/community/index.html
@@ -67,11 +67,18 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
- </li>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../get-started">Get Started</a></li>
+ <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../get-started/environment">Environment</a></li>
+ <li><a href="../get-started/architecture">Architecture</a></li>
+ <li><a href="../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../download">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../community">Community</a>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../project-components/ingestion">Ingestion</a></li>
<li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -122,22 +131,26 @@
<h1>Apache Spot Mailing Lists and Chat Rooms</h1>
<p>Get help using Spot or contribute to the project on our mailing lists or our chat room:</p>
+ <strong>Get Help</strong>
<ul>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
<li><a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Spot Slack channel</a> - where many Spot developers and users hang out to answer questions and chat.</li>
+ <li><a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issue tracker.</li>
+
</ul>
- <strong>Developer mailing lists</strong>
+ <strong>Developer Mailing Lists</strong>
<ul>
<li><a href="mailto:dev@spot.incubator.apache.org">dev@spot.incubator.apache.org</a> (<a href="mailto:dev-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:dev-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-dev/" target="_blank">archives</a>) - for people who want to contribute code to Spot.</li>
- <li><a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issue tracker.</li>
+
<li><a href="mailto:commits@spot.incubator.apache.org">commits@spot.incubator.apache.org</a> (<a href="mailto:commits-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:commits-subscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/incubator-spot-commits/" target="_blank">archives</a>) - receives an email notification of all code changes to the Spot Git repository.</li>
</ul>
- <strong>Other developer resources</strong>
+ <strong>Community Resources</strong>
<ul>
- <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a></li>
- <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a> - where users and committers will find tools and technical information to commit.</li>
+
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Spot Slack channel</a> - where many Spot developers and users hang out to answer questions and chat.</li>
</ul>
</div>
diff --git a/index.html b/index.html
index 021a820..f3ac606 100755
--- a/index.html
+++ b/index.html
@@ -67,10 +67,17 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <a href="get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="get-started">Get Started</a></li>
+ <li><a href="get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="get-started/environment">Environment</a></li>
+ <li><a href="get-started/architecture">Architecture</a></li>
+ <li><a href="get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="download">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="community">Community</a>
@@ -96,10 +103,12 @@
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="project-components/open-data-models">Open Data Models</a></li>
<li><a href="project-components/ingestion">Ingestion</a></li>
<li><a href="project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -121,7 +130,7 @@
<h1 class="thin">A Community Approach to Fighting Cyber Threats</h1>
</div>
<div class="m-all t-1of2 d-1of2 contribute">
- <h3>Help Spot expand his hunting ground to see deeper into the darkness of cyber threats.</h3>
+ <h3>Help Spot expand its hunting ground to see deeper into the darkness of cyber threats.</h3>
<p class="btn-margin"><a href="community/contribute" class="y-btn">Become a Contributor</a></p>
</div>
</div>
@@ -130,7 +139,9 @@
<div id="at-a-glance">
<div class="wrap cf">
<h1>Apache Spot at a Glance</h1>
- <p>Apache Spot is a community-driven cybersecurity project, built from the ground up, to bring advanced analytics to all IT Telemetry data on an open, scalable platform. Spot expedites threat detection, investigation, and remediation via machine learning and consolidates all enterprise security data into a comprehensive IT telemetry hub based on open data models. Spot’s scalability and machine learning capabilities support an ecosystem of ML-based applications that can run [...]
+ <p>Apache Spot is a community-driven cybersecurity project, built from the ground up, to bring advanced analytics to all IT <a href="doc/index.html#telemetry">Telemetry</a> data on an open, scalable platform. It is an open source software for leveraging insights from flow and packet analysis. Spot expedites threat detection, investigation, and remediation via <a href="doc/index.html#machine-learning">machine learning</a> and consolidates all enterprise security data into a [...]
+
+ <p>Apache Spot helps enterprises and service providers gain insight on their computed environments through transparency of service delivery and identification of potential security threats or attacks happening among resources operating at cloud scale. While current threat intelligence tools help, identifying unknown threats and attacks remains a challenge. Spot harnesses a diverse community of expertise from Centrify, Cloudera, Cybraics, Endgame, Intel, Jask, Streamsets, [...]
</div>
</div>
@@ -138,6 +149,8 @@
<div id="inner-content" class="wrap cf">
<main id="main" class="m-all t-all d-all cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
<h1 class="center">Apache Spot Advantages</h1>
+ <p>Apache Spot uses the best tools just to provide the best functionality preventing attacks, identifying unknown threats, and providing cybersecurity. Perimeter Flows, DNS, Proxy and Internal Flows provide remarkable advantages creating fast and efficient data analysis.</p>
+
<p style="text-align: center;"><img src="library/images/advantages-1.png" alt="advantages" width="958" height="433" class="aligncenter size-full" />
</p>
</main>
@@ -174,6 +187,16 @@
<img src="library/images/how-it-works.png" alt="" />
</div>
</div>
+ <div class="wrap cf">
+ <h3>Parallel Ingest Framework.</h3>
+ <p>The systems uses opens source’s optimized decoders for binary flow and pack data, to load into HDFS and data structures inside Hadoop. The decoded data is stored in multiple formats so it is available for searching, used by machine learning, transfer to law enforcement, or inputs to other systems.</p>
+
+ <h3>Machine Learning.</h3>
+ <p>The system uses a combination of Apache Spark to run scalable machine learning algorithms. The machine learning component works not only as a filter for separating bad traffic from benign, but also as a way to characterize the unique behavior of network traffic in an organization.</p>
+
+ <h3>Operational Analytics.</h3>
+ <p>In addition to machine learning, a proven process of context enrichment, noise filtering, whitelisting, and heuristics are applied to network data to produce a short list of the most likely patterns, which may be security threats.</p>
+ </div>
</div>
<div id="key-features">
@@ -251,7 +274,7 @@
</div>
</div>
<p>
- Spot provides common open data model for network, endpoint, and user – Open Data Models. These Open Data Models provide a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
+ Apache Spot delivers common Open Data Models for network, endpoint and user, providing a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
</p>
</div>
<div class="m-all t-1of2 d-1of2">
@@ -266,7 +289,7 @@
</div>
</div>
<p>
- Spot’s Open Data Models help organizations quickly share new analytics with one another as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
+ Apache Spot's Open Data Models help organizations to quickly share new analytics among them as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
</p>
</div>
@@ -305,21 +328,6 @@
<p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
- <div class="community">
- <img src="library/images/community/endgame.png" alt="Endgame" />
- <img src="library/images/community/intel.png" alt="Intel" />
- <img src="library/images/community/webroot.png" alt="Webroot" />
- <img src="library/images/community/jask.png" alt="Jask" />
- <img src="library/images/community/cloudera.png" alt="Cloudera" />
- <img src="library/images/community/cloudwick.png" alt="Cloudwick" />
- <img src="library/images/community/cybraics.png" alt="Cybraics" />
- <img src="library/images/community/centrify.png" alt="Centrify" />
- <img src="library/images/community/ebay.png" alt="Ebay" />
- <img src="library/images/community/semantix.png" alt="Semantix" />
- <img src="library/images/community/rich-it.png" alt="Rich-It" />
- <img src="library/images/community/streamsets.png" alt="StreamSets" />
- </div>
-
</div>
</div>
@@ -337,7 +345,7 @@
<div class="table-cell">
<h3>Network Traffic Analytics</h3>
<p>
- Spot allows organizations to detect potentially malicious activity by identifying suspicious network connections, by analyzing large amounts of netflow, DNS, proxy data with algorithms that are available out of the box.
+ Spot allows organizations to detect potentially malicious activity by identifying suspicious network connections, by analyzing large amounts of <a href="doc/index.html#netflow">netflow</a>, <a href="doc/index.html#dns">DNS</a>, <a href="doc/index.html#proxy">proxy</a> data with algorithms that are available out of the box.
</p>
</div>
</div>
@@ -349,9 +357,9 @@
<img src="library/images/Apache-Spot-Icon_Reduction-Mean-Time.png" alt="" />
</div>
<div class="table-cell">
- <h3>Reduction of mean time to incident detection &resolution (MTTR)</h3>
+ <h3>Reduction of mean time to incident detection & resolution (MTTR)</h3>
<p>
- Spot provides the capability for a central data store that houses ALL the data needed to facilitate an investigation, returning investigative query results in seconds and minutes (vs. hours and days), which effectively reduces incident MTTR and minimizes the adverse impacts of a breach.
+ Spot provides the capability for a central data store that houses ALL the data needed to facilitate an investigation, returning investigative query results in seconds and minutes (vs. hours and days), which effectively reduces incident <a href="doc/index.html#mttr">MTTR</a> and minimizes the adverse impacts of a breach.
</p>
</div>
</div>
@@ -365,7 +373,7 @@
<div class="table-cell">
<h3>Threat Hunting</h3>
<p>
- Spot improves the efficacy of threat hunting by providing the analytic flexibility to perform ad-hoc searches and queries over vast amounts of data, as well as applying ad-hoc algorithms to detect the needle in the haystack.
+ Spot improves the efficacy of threat hunting by providing the analytic flexibility to perform <a href="doc/index.html#ad-hoc">ad-hoc</a> searches and queries over vast amounts of data, as well as applying ad-hoc algorithms to detect the needle in the haystack.
</p>
</div>
</div>
@@ -379,7 +387,7 @@
<div class="table-cell">
<h3>Cybersecurity Data Management</h3>
<p>
- Offloading data from legacy cybersecurity systems (e.g., SIEMs) to Spot delivers immediate economic value, because of the cost of data storage and processing with Hadoop. It also opens up future value as organizations deploy one of the many analytics use cases on their newly formed security data hub.
+ Offloading data from legacy cybersecurity systems (e.g., <a href="doc/index.html#siem">SIEMs</a>) to Spot delivers immediate economic value, because of the cost of data storage and processing with Hadoop. It also opens up future value as organizations deploy one of the many analytics use cases on their newly formed security data hub.
</p>
</div>
</div>
[incubator-spot] 22/45: Contact email and social media URL updates
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 7dfe13409bf0c6084f0632eb60360a9d12df8fdd
Author: Cesar <ce...@apache.org>
AuthorDate: Wed Feb 22 01:14:20 2017 -0600
Contact email and social media URL updates
---
2016/.DS_Store | Bin 0 -> 6148 bytes
2016/03/index.html | 2 +-
2016/08/index.html | 2 +-
2016/09/index.html | 2 +-
2016/10/index.html | 2 +-
blog/apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
blog/index.html | 2 +-
blog/jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
category/cybersecurity/index.html | 2 +-
category/data-science/index.html | 2 +-
category/ipython-notebooks/index.html | 2 +-
category/security-analytics/index.html | 2 +-
category/threat-analysis-tools/index.html | 2 +-
category/uncategorized/index.html | 2 +-
contribute/index.html | 4 ++--
doc/index.html | 4 ++--
index.html | 4 ++--
project-components/ingestion/index.html | 4 ++--
project-components/machine-learning/index.html | 4 ++--
project-components/open-data-models/index.html | 4 ++--
project-components/visualization/index.html | 4 ++--
tag/github/index.html | 2 +-
tag/open-network-insight/index.html | 2 +-
tag/open-source/index.html | 2 +-
27 files changed, 33 insertions(+), 33 deletions(-)
diff --git a/2016/.DS_Store b/2016/.DS_Store
new file mode 100644
index 0000000..e8e8149
Binary files /dev/null and b/2016/.DS_Store differ
diff --git a/2016/03/index.html b/2016/03/index.html
index fb685ff..c8010e3 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/2016/08/index.html b/2016/08/index.html
index 32a8afb..d31c9e9 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/2016/09/index.html b/2016/09/index.html
index 8c55c1e..5f456cc 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/2016/10/index.html b/2016/10/index.html
index d10d2d5..81993a0 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index fd2e424..6801d0c 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 8eafd08..e2001d6 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 79a8523..7f7a612 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/blog/index.html b/blog/index.html
index b875c52..a5cbdd4 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index d750307..68d8ffd 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 7aef5e4..e15329e 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 60493e9..baccf1d 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 4aea8b4..c2a2518 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 193c5f1..3445cf1 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index d673813..2ac8872 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index d21b80c..7097759 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index b2a13a5..e529687 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/contribute/index.html b/contribute/index.html
index ee0cdaa..325939b 100755
--- a/contribute/index.html
+++ b/contribute/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
@@ -183,7 +183,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/doc/index.html b/doc/index.html
index 83beeca..2bfaeef 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -1315,11 +1315,11 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
- <a href="https://github.com/Open-Network-Insight/open-network-insight" class="y-btn" target="_blank">More Info</a>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
</p>
<p style="margin-top:50px;"><img src="images/apache-incubator.png" alt="Apache Incubator" />
diff --git a/index.html b/index.html
index cc9d552..815d1c9 100755
--- a/index.html
+++ b/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
@@ -377,7 +377,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 58d49a1..1c2c877 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
@@ -164,7 +164,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index d0c7d42..2224750 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
@@ -142,7 +142,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 7a39767..753b5bb 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
@@ -147,7 +147,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index cb10290..b65ce18 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
@@ -163,7 +163,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/tag/github/index.html b/tag/github/index.html
index ea7ce75..511beef 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index d797b2f..2e6a146 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 489d631..c7738d7 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -58,7 +58,7 @@
<div id="container">
<div class="social-sidebar">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
<a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
[incubator-spot] 03/45: Import website content.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 5d5c25028785527c139048c8b8dcbc6fcafdb6f8
Author: Doug Cutting <cu...@apache.org>
AuthorDate: Tue Sep 27 13:56:20 2016 -0700
Import website content.
---
2016/03/index.html | 279 +++++
2016/08/index.html | 307 ++++++
blog/index.html | 323 ++++++
category/cybersecurity/feed/index.html | 51 +
category/cybersecurity/index.html | 280 +++++
category/security-analytics/feed/index.html | 51 +
category/security-analytics/index.html | 280 +++++
category/uncategorized/feed/index.html | 47 +
category/uncategorized/index.html | 281 +++++
comments/feed/index.html | 18 +
feed/index.html | 107 ++
.../feed/index.html | 18 +
.../index.html | 306 ++++++
index.html | 549 +++++++++-
.../feed/index.html | 18 +
.../index.html | 319 ++++++
.../feed/index.html | 18 +
.../index.html | 324 ++++++
tag/github/feed/index.html | 51 +
tag/github/index.html | 280 +++++
tag/open-network-insight/feed/index.html | 51 +
tag/open-network-insight/index.html | 280 +++++
tag/open-source/feed/index.html | 51 +
tag/open-source/index.html | 280 +++++
wp-content/themes/oni/favicon.png | Bin 0 -> 564 bytes
wp-content/themes/oni/library/css/meanmenu.css | 168 +++
wp-content/themes/oni/library/css/style.css | 1069 ++++++++++++++++++++
wp-content/themes/oni/library/fonts/icomoon.eot | Bin 0 -> 1736 bytes
wp-content/themes/oni/library/fonts/icomoon.svg | 13 +
wp-content/themes/oni/library/fonts/icomoon.ttf | Bin 0 -> 1572 bytes
wp-content/themes/oni/library/fonts/icomoon.woff | Bin 0 -> 1648 bytes
wp-content/themes/oni/library/images/and.png | Bin 0 -> 880 bytes
.../themes/oni/library/images/apache-incubator.png | Bin 0 -> 7213 bytes
.../themes/oni/library/images/apple-touch-icon.png | Bin 0 -> 5971 bytes
.../themes/oni/library/images/key_features_bg.jpg | Bin 0 -> 23292 bytes
wp-content/themes/oni/library/images/logo.png | Bin 0 -> 8007 bytes
.../themes/oni/library/images/masthead-bg.png | Bin 0 -> 70435 bytes
.../themes/oni/library/images/quote-person.png | Bin 0 -> 1079 bytes
wp-content/themes/oni/library/images/quotes.png | Bin 0 -> 886 bytes
wp-content/themes/oni/library/images/search.png | Bin 0 -> 391 bytes
.../themes/oni/library/js/jquery.meanmenu.js | 285 ++++++
.../oni/library/js/libs/modernizr.custom.min.js | 4 +
wp-content/themes/oni/library/js/scripts.js | 120 +++
wp-content/uploads/2016/03/FloCon2015-300x225.png | Bin 0 -> 40316 bytes
wp-content/uploads/2016/03/FloCon2015-768x576.png | Bin 0 -> 111556 bytes
wp-content/uploads/2016/03/FloCon2015.png | Bin 0 -> 43681 bytes
.../uploads/2016/03/SPOT_Collabration-Icon_v2.png | Bin 0 -> 19033 bytes
.../uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png | Bin 0 -> 18850 bytes
.../uploads/2016/03/advantages-1-300x136.png | Bin 0 -> 16738 bytes
.../uploads/2016/03/advantages-1-768x347.png | Bin 0 -> 54522 bytes
wp-content/uploads/2016/03/advantages-1.png | Bin 0 -> 35716 bytes
wp-content/uploads/2016/03/connects.png | Bin 0 -> 2846 bytes
wp-content/uploads/2016/03/how-it-works.png | Bin 0 -> 47916 bytes
wp-content/uploads/2016/03/magnify-icon.png | Bin 0 -> 2899 bytes
wp-content/uploads/2016/03/spot470.png | Bin 0 -> 16211 bytes
wp-content/uploads/2016/03/storyboard-icon.png | Bin 0 -> 2458 bytes
wp-content/uploads/2016/03/threat-icon.png | Bin 0 -> 2652 bytes
.../ONI_Architecture-Diagram_1300_v4-1024x532.png | Bin 0 -> 309743 bytes
.../ONI_Architecture-Diagram_1300_v4-300x156.png | Bin 0 -> 36669 bytes
.../ONI_Architecture-Diagram_1300_v4-768x399.png | Bin 0 -> 185948 bytes
.../2016/09/ONI_Architecture-Diagram_1300_v4.png | Bin 0 -> 431626 bytes
wp-includes/js/comment-reply.min.js | 1 +
wp-includes/js/jquery/jquery-migrate.min.js | 2 +
wp-includes/js/jquery/jquery.js | 6 +
wp-includes/js/wp-embed.min.js | 1 +
wp-json/index.html | 1 +
66 files changed, 6231 insertions(+), 8 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
new file mode 100644
index 0000000..4971dc0
--- /dev/null
+++ b/2016/03/index.html
@@ -0,0 +1,279 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot 2016 March</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: March 2016</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/2016/08/index.html b/2016/08/index.html
new file mode 100644
index 0000000..455c751
--- /dev/null
+++ b/2016/08/index.html
@@ -0,0 +1,307 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot 2016 August</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: August 2016</h1>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-det [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-open-network-insight-helps-create-well-st [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/blog/index.html b/blog/index.html
new file mode 100644
index 0000000..81a376e
--- /dev/null
+++ b/blog/index.html
@@ -0,0 +1,323 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Blog</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="blog" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
+ <a href="../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-de [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-open-network-insight-helps-create-well-s [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/cybersecurity/feed/index.html b/category/cybersecurity/feed/index.html
new file mode 100644
index 0000000..01c43db
--- /dev/null
+++ b/category/cybersecurity/feed/index.html
@@ -0,0 +1,51 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Cybersecurity – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/category/cybersecurity/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+ <link>http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <comments>http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
+ <pubDate>Mon, 08 Aug 2016 08:00:32 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Cybersecurity]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=117</guid>
+ <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-net [...]
+ <content:encoded><![CDATA[<p>The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each att [...]
+<p>Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:</p>
+<ol>
+<li>Collect information from each device that is part of the environment.</li>
+<li>Collect information from the critical infrastructure that is used for most, if not all, of the systems.</li>
+</ol>
+<p>This blog will describe the second approach.</p>
+<p>Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or services, that need to be up and runn [...]
+<p>Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.</p>
+<p>Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?</p>
+<p>First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other challenge.</p>
+<p>Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenarios. With Apache Spot, attacks that [...]
+<p>Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.</p>
+<p><strong>But Wait, There’s More</strong></p>
+<p>Check out “<a href="http://spot.incubator.apache.org/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
+<p>This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
new file mode 100644
index 0000000..676bc20
--- /dev/null
+++ b/category/cybersecurity/index.html
@@ -0,0 +1,280 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Cybersecurity</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Cybersecurity Category Feed" href="../../category/cybersecurity/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive category category-cybersecurity category-9" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Cybersecurity</h1>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-det [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/security-analytics/feed/index.html b/category/security-analytics/feed/index.html
new file mode 100644
index 0000000..690f185
--- /dev/null
+++ b/category/security-analytics/feed/index.html
@@ -0,0 +1,51 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Security Analytics – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/category/security-analytics/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Apache Spot: Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Security Analytics]]></category>
+ <category><![CDATA[github]]></category>
+ <category><![CDATA[open network insight]]></category>
+ <category><![CDATA[open source]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
+<p><strong>What Is Apache Spot?</strong><br />
+Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
+<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
+<p><strong>Why Intel?</strong></p>
+<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
+<p><strong>Why Open Source?</strong></p>
+<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>Fork us on Github!</p>
+<p>Grant Babb</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
new file mode 100644
index 0000000..ea98511
--- /dev/null
+++ b/category/security-analytics/index.html
@@ -0,0 +1,280 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Security Analytics</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Security Analytics Category Feed" href="../../category/security-analytics/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive category category-security-analytics category-4" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Security Analytics</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/category/uncategorized/feed/index.html b/category/uncategorized/feed/index.html
new file mode 100644
index 0000000..123b112
--- /dev/null
+++ b/category/uncategorized/feed/index.html
@@ -0,0 +1,47 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Uncategorized – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org//category/uncategorized/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <link>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <comments>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
+ <pubDate>Mon, 08 Aug 2016 07:59:41 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Uncategorized]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org//?p=113</guid>
+ <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//how-open-network-insight-helps-c [...]
+ <content:encoded><![CDATA[<p>About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what order [...]
+<p>Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.</p>
+<a href="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org//wp-content/uploads/201 [...]
+<h3><strong>Apache Spot Core Components</strong></h3>
+<p>The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.</p>
+<p>In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and ensures that resources can grow [...]
+<h3><strong>Operational Analytics</strong></h3>
+<p>As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data using different algorithms to ident [...]
+<h3><strong>Visualizing Results</strong></h3>
+<p>The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.</p>
+<h3><strong>Customizable Open Source</strong></h3>
+<p>Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
new file mode 100644
index 0000000..ef9156d
--- /dev/null
+++ b/category/uncategorized/index.html
@@ -0,0 +1,281 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Uncategorized</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Uncategorized Category Feed" href="../../category/uncategorized/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ };
+ ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive category category-uncategorized category-1" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Uncategorized</h1>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-open-network-insight-helps-create-well-st [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/comments/feed/index.html b/comments/feed/index.html
new file mode 100644
index 0000000..bcc70d4
--- /dev/null
+++ b/comments/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments for Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org//comments/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/feed/index.html b/feed/index.html
new file mode 100644
index 0000000..881aa0e
--- /dev/null
+++ b/feed/index.html
@@ -0,0 +1,107 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org//feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+ <link>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <comments>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
+ <pubDate>Mon, 08 Aug 2016 08:00:32 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Cybersecurity]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org//?p=117</guid>
+ <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-ne [...]
+ <content:encoded><![CDATA[<p>The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each att [...]
+<p>Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:</p>
+<ol>
+<li>Collect information from each device that is part of the environment.</li>
+<li>Collect information from the critical infrastructure that is used for most, if not all, of the systems.</li>
+</ol>
+<p>This blog will describe the second approach.</p>
+<p>Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or services, that need to be up and runn [...]
+<p>Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.</p>
+<p>Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?</p>
+<p>First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other challenge.</p>
+<p>Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenarios. With Apache Spot, attacks that [...]
+<p>Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.</p>
+<p><strong>But Wait, There’s More</strong></p>
+<p>Check out “<a href="http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
+<p>This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ <item>
+ <title>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <link>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <comments>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
+ <pubDate>Mon, 08 Aug 2016 07:59:41 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Uncategorized]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org//?p=113</guid>
+ <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//how-open-network-insight-helps-c [...]
+ <content:encoded><![CDATA[<p>About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what order [...]
+<p>Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.</p>
+<a href="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org//wp-content/uploads/201 [...]
+<h3><strong>Apache Spot Core Components</strong></h3>
+<p>The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.</p>
+<p>In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and ensures that resources can grow [...]
+<h3><strong>Operational Analytics</strong></h3>
+<p>As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data using different algorithms to ident [...]
+<h3><strong>Visualizing Results</strong></h3>
+<p>The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.</p>
+<h3><strong>Customizable Open Source</strong></h3>
+<p>Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ <item>
+ <title>Apache Spot: Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/#respond</comments>
+ <pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Security Analytics]]></category>
+ <category><![CDATA[github]]></category>
+ <category><![CDATA[open network insight]]></category>
+ <category><![CDATA[open source]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org//?p=62</guid>
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions [...]
+ <content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
+<p><strong>What Is Apache Spot?</strong><br />
+Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
+<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
+<a href="http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, h [...]
+<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
+<p><strong>Why Intel?</strong></p>
+<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
+<p><strong>Why Open Source?</strong></p>
+<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>Fork us on Github!</p>
+<p>Grant Babb</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html
new file mode 100644
index 0000000..5d01923
--- /dev/null
+++ b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <atom:link href="http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
new file mode 100644
index 0000000..48fcd16
--- /dev/null
+++ b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -0,0 +1,306 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights Comments Feed" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" />
+ <link rel='shortlink' href='../?p=113' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fhow-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fhow-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights%2F&format=xml" />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post postid-113 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
+ </p>
+ <p>
+ Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
+ </p>
+ <a href="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, ../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png 300w, ../wp-content/uploads/2016/09/ONI_Ar [...]
+ <h3><strong>Apache Spot Core Components</strong></h3>
+ <p>
+ The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
+ </p>
+ <p>
+ In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
+ </p>
+ <h3><strong>Operational Analytics</strong></h3>
+ <p>
+ As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
+ </p>
+ <h3><strong>Visualizing Results</strong></h3>
+ <p>
+ The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
+ </p>
+ <h3><strong>Customizable Open Source</strong></h3>
+ <p>
+ Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../category/uncategorized/" rel="category tag">Uncategorized</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/index.html b/index.html
index b133f83..f574b4d 100644
--- a/index.html
+++ b/index.html
@@ -1,9 +1,542 @@
-<html>
- <head>
- <title>Apache Spot (incubating)</title>
- </head>
-<body>
-<h1>Apache Spot (incubating)</h1>
-Apache Spot placeholder page.
-</body>
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="comments/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='wp-json/' />
+ <link rel="canonical" href="" />
+ <link rel='shortlink' href='' />
+ <link rel="alternate" type="application/json+oembed" href="wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2F&format=xml" />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="home page page-id-8 page-template-default" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all t-1of2 d-1of2 oni-guy">
+ <img src="wp-content/uploads/2016/03/spot470.png" class="oniguy" alt="" />
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <h2>Apache Spot (Incubating)
+ <br>
+ at a Glance</h2>
+ <p>
+ For organizations with dynamic data centers and networks, Apache Spot is an advanced threat detection solution that uses big data analytics, that perform at cloud scale, to provide actionable insights into operational and security threats. Running on Cloudera Enterprise Data Hub (EDH), Apache Spot can analyze billions of events in order to detect unknown threats, insider threats, and gain a new level of visibility into the network.
+ </p>
+ <p class="btn-margin">
+ <a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div id="content">
+ <div id="inner-content" class="wrap cf">
+ <main id="main" class="m-all t-all d-all cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+ <h1 class="center">Apache Spot Advantages</h1>
+ <p style="text-align: center;"><img src="wp-content/uploads/2016/03/advantages-1.png" alt="advantages" width="958" height="433" class="aligncenter size-full wp-image-139" srcset="wp-content/uploads/2016/03/advantages-1.png 958w, wp-content/uploads/2016/03/advantages-1-300x136.png 300w, wp-content/uploads/2016/03/advantages-1-768x347.png 768w" sizes="(max-width: 958px) 100vw, 958px" />
+ </p>
+ </main>
+ </div>
+ </div>
+
+ <div id="and">
+ <div class="wrap cf">
+ <div class="and-row">
+ <div class="and-cell">
+ <img src="wp-content/themes/oni/library/images/and.png" alt="" />
+ </div>
+ <div class="and-cell">
+ <p>
+ Apache Spot is functional after just one day and just keeps improving through feedback and machine learning.
+ </p>
+ </div>
+ </div>
+ </div>
+ </div>
+
+ <div id="how-it-works">
+ <div class="wrap cf">
+ <div class="m-all t-1of3 d-1of3">
+ <h1>How It Works</h1>
+ <p>
+ Apache Spot uses machine learning as a filter for separating bad traffic from benign and to characterize the unique behavior of network traffic. A proven process, of context enrichment, noise filtering, whitelisting and heuristics, is also applied to network data to produce a shortlist of most likely security threats.
+ </p>
+ <p class="btn-margin">
+ <a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
+ </p>
+ </div>
+ <div class="m-all t-2of3 d-2of3">
+ <img src="wp-content/uploads/2016/03/how-it-works.png" alt="" />
+ </div>
+ </div>
+ </div>
+
+ <div id="key-features">
+ <div class="wrap cf">
+ <h1>Key Features</h1>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="wp-content/uploads/2016/03/magnify-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Suspicious DNS packets</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Apache Spot is capable of performing deep-packet inspection of DNS traffic to build a profile of probable and improbable DNS payloads. After visualizing, normalizing, and conducting pattern searches, the analyst has a shortlist of the most likely threats present in DNS traffic.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="wp-content/uploads/2016/03/threat-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Threat Incident and Response</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Given an IP address, Apache Spot gathers all the characteristics about the communication associated with it – the “social network” of that IP address. Then Apache Spot builds a timeline of the conversations that originated with that IP.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="wp-content/uploads/2016/03/connects.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Suspicious Connects</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Apache Spot uses advanced machine learning to build a model of the machines on the network and their communication patterns. The connections between the machines that are the lowest probability are then visualized, filtered for noise, and searched for known patterns. The result is the most likely threat patterns in the data, a few hundred flows picked from billions.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="wp-content/uploads/2016/03/storyboard-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Storyboard</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ After an analyst has investigated a threat, the need still exists to communicate the event up and across the organization. A “dashboard” gives quick answers to the questions you already know to ask. What the analyst requires is a “storyboard,” something that tells who, what, where, and how of the story in words and interactive visualizations.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Open Data Models</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Spot provides common open data model for network, endpoint, and user – Open Data Models. These Open Data Models provide a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Collaboration</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Spot’s Open Data Models help organizations quickly share new analytics with one another as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
+ </p>
+ </div>
+
+ <div class="cf"></div>
+ <p class="btn-margin">
+ <a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
+ </p>
+ </div>
+ </div>
+
+ <div id="user-stories">
+ <div class="wrap cf">
+ <h1>Spot Fosters a Rich Application Ecosystem</h1>
+ <p class="btn-margin center">
+ Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
+ </p>
+ <!--
+ <div class="quotes">
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
+ <h3>Senior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”</p> </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
+ <h3>Junior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
+ </p> </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
+ <h3>Decision Maker</h3>
+ </div>
+ <div class="table-cell">
+ <p>...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
+ </p> </div>
+ </div>
+ </div>
+
+ </div>-->
+
+ </div>
+ </div>
+
+ <div id="use-case">
+ <div class="wrap cf">
+
+ <h1>Use Case</h1>
+ <div class="quotes">
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
+ <h3>Senior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
+ <h3>Junior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
+ <h3>Decision Maker</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ </div>
+
+ <!--
+ <div class="m-all t-1of2 d-4of7 left">
+ <img src="wp-content/uploads/2016/03/use-case-graphic.png" alt="" />
+ </div>
+ <div class="m-all t-1of2 d-3of7 right">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell number">
+ <img src="wp-content/themes/oni/library/images/one.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <p>Deliver suspicious connections in <strong>ranked</strong> order with multiple data points such as time, traffic flow, and more.</p> </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell number">
+ <img src="wp-content/themes/oni/library/images/two.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <p>Human input helps the system evolve. <strong>Quickly eliminate false positives from the lineup.</strong></p> </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell number">
+ <img src="wp-content/themes/oni/library/images/three.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <p>And make every item on the list <strong>worth your time</strong> to investigate.</p> </div>
+ </div>
+ </div>
+
+ </div> -->
+
+ </div>
+
+ <div class="arrow">
+ <div class="wrap cf">
+ <p>
+ Identify the needle in the haystack with <strong>patterns</strong> that provide insight into potential threats.
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/onihadoop" target="_blank"><span class="icon-twitter"></span></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/Open-Network-Insight/open-network-insight" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="wp-content/themes/oni/library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
</html>
+<!-- end of site. what a ride! -->
diff --git a/open-network-insight-3-most-asked-questions/feed/index.html b/open-network-insight-3-most-asked-questions/feed/index.html
new file mode 100644
index 0000000..bcf95eb
--- /dev/null
+++ b/open-network-insight-3-most-asked-questions/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot: Three Most-Asked Questions</title>
+ <atom:link href="http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/open-network-insight-3-most-asked-questions/index.html b/open-network-insight-3-most-asked-questions/index.html
new file mode 100644
index 0000000..7d98703
--- /dev/null
+++ b/open-network-insight-3-most-asked-questions/index.html
@@ -0,0 +1,319 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Apache Spot: Three Most-Asked Questions</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Apache Spot: Three Most-Asked Questions Comments Feed" href="../open-network-insight-3-most-asked-questions/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="../open-network-insight-3-most-asked-questions/" />
+ <link rel='shortlink' href='../?p=62' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-3-most-asked-questions%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-3-most-asked-questions%2F&format=xml" />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post postid-62 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot: Three Most-Asked Questions</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.
+ </p>
+ <p>
+ <strong>What Is Apache Spot?</strong>
+ <br />
+ Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security [...]
+ </p>
+ <p>
+ We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an [...]
+ <br />
+ <a href="../wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="../wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="../wp-content/uploads/2016/03/FloCon2015.png 960w, ../wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, ../wp-content/uploads/2016/03/FloCon2015-768x576.png 768w" sizes="(max-width: 960px) 100v [...]
+ </p>
+ <p>
+ The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.
+ </p>
+ <p>
+ <strong>Why Intel?</strong>
+ </p>
+ <p>
+ At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some prett [...]
+ </p>
+ <p>
+ <strong>Why Open Source?</strong>
+ </p>
+ <p>
+ I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.
+ </p>
+ <p>
+ The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuo [...]
+ </p>
+ <p>
+ Fork us on Github!
+ </p>
+ <p>
+ Grant Babb
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../category/security-analytics/" rel="category tag">Security Analytics</a>
+ <p class="tags">
+ <span class="tags-title">Tags:</span><a href="../tag/github/" rel="tag">github</a>, <a href="../tag/open-network-insight/" rel="tag">open network insight</a>, <a href="../tag/open-source/" rel="tag">open source</a>
+ </p>
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
new file mode 100644
index 0000000..de25844
--- /dev/null
+++ b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+ <atom:link href="http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
new file mode 100644
index 0000000..7a7cc0e
--- /dev/null
+++ b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -0,0 +1,324 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure Comments Feed" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" />
+ <link rel='shortlink' href='../?p=117' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure%2F&format=xml" />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post postid-117 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each attack?
+ </p>
+ <p>
+ Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:
+ </p>
+ <ol>
+ <li>
+ Collect information from each device that is part of the environment.
+ </li>
+ <li>
+ Collect information from the critical infrastructure that is used for most, if not all, of the systems.
+ </li>
+ </ol>
+ <p>
+ This blog will describe the second approach.
+ </p>
+ <p>
+ Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or serv [...]
+ </p>
+ <p>
+ Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.
+ </p>
+ <p>
+ Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?
+ </p>
+ <p>
+ First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
+ </p>
+ <p>
+ Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
+ </p>
+ <p>
+ Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
+ </p>
+ <p>
+ <strong>But Wait, There’s More</strong>
+ </p>
+ <p>
+ Check out “<a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
+ </p>
+ <p>
+ This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../category/cybersecurity/" rel="category tag">Cybersecurity</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/tag/github/feed/index.html b/tag/github/feed/index.html
new file mode 100644
index 0000000..f385614
--- /dev/null
+++ b/tag/github/feed/index.html
@@ -0,0 +1,51 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>github – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/tag/github/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Apache Spot: Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Security Analytics]]></category>
+ <category><![CDATA[github]]></category>
+ <category><![CDATA[open network insight]]></category>
+ <category><![CDATA[open source]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
+<p><strong>What Is Apache Spot?</strong><br />
+Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
+<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
+<p><strong>Why Intel?</strong></p>
+<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
+<p><strong>Why Open Source?</strong></p>
+<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>Fork us on Github!</p>
+<p>Grant Babb</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/tag/github/index.html b/tag/github/index.html
new file mode 100644
index 0000000..a084a84
--- /dev/null
+++ b/tag/github/index.html
@@ -0,0 +1,280 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot github</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » github Tag Feed" href="../../tag/github/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag tag-github tag-6" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: github</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/tag/open-network-insight/feed/index.html b/tag/open-network-insight/feed/index.html
new file mode 100644
index 0000000..e9db2f3
--- /dev/null
+++ b/tag/open-network-insight/feed/index.html
@@ -0,0 +1,51 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>open network insight – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/tag/open-network-insight/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Apache Spot: Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Security Analytics]]></category>
+ <category><![CDATA[github]]></category>
+ <category><![CDATA[open network insight]]></category>
+ <category><![CDATA[open source]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
+<p><strong>What Is Apache Spot?</strong><br />
+Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
+<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
+<p><strong>Why Intel?</strong></p>
+<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
+<p><strong>Why Open Source?</strong></p>
+<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>Fork us on Github!</p>
+<p>Grant Babb</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
new file mode 100644
index 0000000..0b20aed
--- /dev/null
+++ b/tag/open-network-insight/index.html
@@ -0,0 +1,280 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot open network insight</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » open network insight Tag Feed" href="../../tag/open-network-insight/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag tag-open-network-insight tag-7" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: open network insight</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/tag/open-source/feed/index.html b/tag/open-source/feed/index.html
new file mode 100644
index 0000000..a971588
--- /dev/null
+++ b/tag/open-source/feed/index.html
@@ -0,0 +1,51 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>open source – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/tag/open-source/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Apache Spot: Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Security Analytics]]></category>
+ <category><![CDATA[github]]></category>
+ <category><![CDATA[open network insight]]></category>
+ <category><![CDATA[open source]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
+<p><strong>What Is Apache Spot?</strong><br />
+Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
+<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
+<p><strong>Why Intel?</strong></p>
+<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
+<p><strong>Why Open Source?</strong></p>
+<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>Fork us on Github!</p>
+<p>Grant Babb</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
new file mode 100644
index 0000000..aae3a92
--- /dev/null
+++ b/tag/open-source/index.html
@@ -0,0 +1,280 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot open source</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="../../xmlrpc.php">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » open source Tag Feed" href="../../tag/open-source/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "ext" : ".png",
+ "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
+ "svgExt" : ".svg",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f,
+ g,
+ h = b.createElement("canvas"),
+ i = h.getContext && h.getContext("2d"),
+ j = String.fromCharCode;
+ if (!i || !i.fillText)
+ return !1;
+ switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ case"flag":
+ return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
+ c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
+ d = h.toDataURL(), c !== d);
+ case"diversity":
+ return i.fillText(j(55356, 57221), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
+ e = i.getImageData(16, 16, 1, 1).data,
+ g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ case"simple":
+ return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ case"unicode9":
+ return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../../wp-json/' />
+
+ <script>
+ (function(i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r;
+ i[r] = i[r] ||
+ function() {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date();
+ a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0];
+ a.async = 1;
+ a.src = g;
+ m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-75955621-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag tag-open-source tag-5" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: open source</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/wp-content/themes/oni/favicon.png b/wp-content/themes/oni/favicon.png
new file mode 100644
index 0000000..e68d33b
Binary files /dev/null and b/wp-content/themes/oni/favicon.png differ
diff --git a/wp-content/themes/oni/library/css/meanmenu.css b/wp-content/themes/oni/library/css/meanmenu.css
new file mode 100644
index 0000000..8f54f9b
--- /dev/null
+++ b/wp-content/themes/oni/library/css/meanmenu.css
@@ -0,0 +1,168 @@
+
+/*! #######################################################################
+
+ MeanMenu 2.0.7
+ --------
+
+ To be used with jquery.meanmenu.js by Chris Wharton (http://www.meanthemes.com/plugins/meanmenu/)
+
+####################################################################### */
+
+/* hide the link until viewport size is reached */
+a.meanmenu-reveal {
+ display: none;
+}
+
+/* when under viewport size, .mean-container is added to body */
+.mean-container .mean-bar {
+ float: left;
+ width: 100%;
+ position: relative;
+ background: #535457;
+ padding: 4px 0;
+ min-height: 42px;
+ z-index: 999999;
+}
+
+.mean-container a.meanmenu-reveal {
+ width: 22px;
+ height: 22px;
+ padding: 13px 13px 11px 13px;
+ position: absolute;
+ top: 0;
+ right: 0;
+ cursor: pointer;
+ color: #f9bf12;
+ text-decoration: none;
+ font-size: 16px;
+ text-indent: -9999em;
+ line-height: 22px;
+ font-size: 1px;
+ display: block;
+ font-family: Arial, Helvetica, sans-serif;
+ font-weight: 700;
+}
+
+.mean-container a.meanmenu-reveal span {
+ display: block;
+ background: #f9bf12;
+ height: 3px;
+ margin-top: 3px;
+}
+
+.mean-container .mean-nav {
+ float: left;
+ width: 100%;
+ background: #535457;
+ margin-top: 44px;
+}
+
+.mean-container .mean-nav ul {
+ padding: 0;
+ margin: 0;
+ width: 100%;
+ list-style-type: none;
+}
+
+.mean-container .mean-nav ul li {
+ position: relative;
+ float: left;
+ width: 100%;
+}
+
+.mean-container .mean-nav ul li a {
+ display: block;
+ float: left;
+ width: 90%;
+ padding: 1em 5%;
+ margin: 0;
+ text-align: left;
+ color: #fff;
+ border-top: 1px solid #383838;
+ border-top: 1px solid rgba(255,255,255,0.5);
+ text-decoration: none;
+ text-transform: uppercase;
+}
+
+.mean-container .mean-nav ul li li a {
+ width: 80%;
+ padding: 1em 10%;
+ border-top: 1px solid #f1f1f1;
+ border-top: 1px solid rgba(255,255,255,0.25);
+ opacity: 0.75;
+ filter: alpha(opacity=75);
+ text-shadow: none !important;
+ visibility: visible;
+}
+
+.mean-container .mean-nav ul li.mean-last a {
+ border-bottom: none;
+ margin-bottom: 0;
+}
+
+.mean-container .mean-nav ul li li li a {
+ width: 70%;
+ padding: 1em 15%;
+}
+
+.mean-container .mean-nav ul li li li li a {
+ width: 60%;
+ padding: 1em 20%;
+}
+
+.mean-container .mean-nav ul li li li li li a {
+ width: 50%;
+ padding: 1em 25%;
+}
+
+.mean-container .mean-nav ul li a:hover {
+ background: #252525;
+ background: rgba(255,255,255,0.1);
+}
+
+.mean-container .mean-nav ul li a.mean-expand {
+ margin-top: 1px;
+ width: 26px;
+ height: 32px;
+ padding: 12px !important;
+ text-align: center;
+ position: absolute;
+ right: 0;
+ top: 0;
+ z-index: 2;
+ font-weight: 700;
+ background: rgba(255,255,255,0.1);
+ border: none !important;
+ border-left: 1px solid rgba(255,255,255,0.4) !important;
+ border-bottom: 1px solid rgba(255,255,255,0.2) !important;
+}
+
+.mean-container .mean-nav ul li a.mean-expand:hover {
+ background: rgba(0,0,0,0.9);
+}
+
+.mean-container .mean-push {
+ float: left;
+ width: 100%;
+ padding: 0;
+ margin: 0;
+ clear: both;
+}
+
+.mean-nav .wrapper {
+ width: 100%;
+ padding: 0;
+ margin: 0;
+}
+
+/* Fix for box sizing on Foundation Framework etc. */
+.mean-container .mean-bar, .mean-container .mean-bar * {
+ -webkit-box-sizing: content-box;
+ -moz-box-sizing: content-box;
+ box-sizing: content-box;
+}
+
+
+.mean-remove {
+ display: none !important;
+}
diff --git a/wp-content/themes/oni/library/css/style.css b/wp-content/themes/oni/library/css/style.css
new file mode 100644
index 0000000..92851fd
--- /dev/null
+++ b/wp-content/themes/oni/library/css/style.css
@@ -0,0 +1,1069 @@
+@import url("https://fonts.googleapis.com/css?family=Roboto+Condensed:400,300,700");
+@import url("https://fonts.googleapis.com/css?family=Open+Sans:400,300,400italic,300italic,600,600italic,700,700italic,800,800italic");
+
+@font-face {
+ font-family: 'icomoon';
+ src: url('../fonts/icomoon.eot?z8h1zd');
+ src: url('../fonts/icomoon.eot?z8h1zd#iefix') format('embedded-opentype'),
+ url('../fonts/icomoon.ttf?z8h1zd') format('truetype'),
+ url('../fonts/icomoon.woff?z8h1zd') format('woff'),
+ url('../fonts/icomoon.svg?z8h1zd#icomoon') format('svg');
+ font-weight: normal;
+ font-style: normal;
+}
+
+[class^="icon-"], [class*=" icon-"] {
+ /* use !important to prevent issues with browser extensions that change fonts */
+ font-family: 'icomoon' !important;
+ speak: none;
+ font-style: normal;
+ font-weight: normal;
+ font-variant: normal;
+ text-transform: none;
+ line-height: 1;
+
+ /* Better Font Rendering =========== */
+ -webkit-font-smoothing: antialiased;
+ -moz-osx-font-smoothing: grayscale;
+}
+
+.icon-envelope:before {
+ content: "\e903";
+}
+.icon-twitter:before {
+ content: "\e901";
+}
+
+
+/* Made with Bones: http://themble.com/bones :) */
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Main Stylesheet
+
+Here's where the magic happens. Here, you'll see we are calling in
+the separate media queries. The base mobile goes outside any query
+and is called at the beginning, after that we call the rest
+of the styles inside media queries.
+
+Helpful articles on Sass file organization:
+http://thesassway.com/advanced/modular-css-naming-conventions
+
+******************************************************************/
+/*********************
+IMPORTING PARTIALS
+These files are needed at the beginning so that we establish all
+our mixins, functions, and variables that we'll be using across
+the whole project.
+*********************/
+/* normalize.css 2012-07-07T09:50 UTC - http://github.com/necolas/normalize.css */
+/* ========================================================================== HTML5 display definitions ========================================================================== */
+/** Correct `block` display not defined in IE 8/9. */
+article, aside, details, figcaption, figure, footer, header, hgroup, main, nav, section, summary { display: block; }
+
+/** Correct `inline-block` display not defined in IE 8/9. */
+audio, canvas, video { display: inline-block; }
+
+/** Prevent modern browsers from displaying `audio` without controls. Remove excess height in iOS 5 devices. */
+audio:not([controls]) { display: none; height: 0; }
+
+/** Address `[hidden]` styling not present in IE 8/9. Hide the `template` element in IE, Safari, and Firefox < 22. */
+[hidden], template { display: none; }
+
+/* ========================================================================== Base ========================================================================== */
+/** 1. Set default font family to sans-serif. 2. Prevent iOS text size adjust after orientation change, without disabling user zoom. */
+html { font-family: sans-serif; /* 1 */ -ms-text-size-adjust: 100%; /* 2 */ -webkit-text-size-adjust: 100%; /* 2 */ }
+
+/** Remove default margin. */
+body { margin: 0; }
+
+/* ========================================================================== Links ========================================================================== */
+/** Remove the gray background color from active links in IE 10. */
+a { background: transparent; }
+
+/** Address `outline` inconsistency between Chrome and other browsers. */
+a:focus { outline: thin dotted; }
+
+/** Improve readability when focused and also mouse hovered in all browsers. */
+a:active, a:hover { outline: 0; }
+
+/* ========================================================================== Typography ========================================================================== */
+/** Address variable `h1` font-size and margin within `section` and `article` contexts in Firefox 4+, Safari 5, and Chrome. */
+h1 { font-size: 2em; margin: 0.67em 0; }
+
+/** Address styling not present in IE 8/9, Safari 5, and Chrome. */
+abbr[title] { border-bottom: 1px dotted; }
+
+/** Address style set to `bolder` in Firefox 4+, Safari 5, and Chrome. */
+b, strong, .strong { font-weight: bold; }
+
+/** Address styling not present in Safari 5 and Chrome. */
+dfn, em, .em { font-style: italic; }
+
+/** Address differences between Firefox and other browsers. */
+hr { -moz-box-sizing: content-box; box-sizing: content-box; height: 0; }
+
+/* proper formatting (http://blog.fontdeck.com/post/9037028497/hyphens)
+*/
+p { -webkit-hyphens: auto; -epub-hyphens: auto; -moz-hyphens: auto; hyphens: auto; }
+
+/* Addresses margins set differently in IE6/7. */
+pre { margin: 0; }
+
+/** Correct font family set oddly in Safari 5 and Chrome. */
+code, kbd, pre, samp { font-family: monospace, serif; font-size: 1em; }
+
+/** Improve readability of pre-formatted text in all browsers. */
+pre { white-space: pre-wrap; }
+
+/** Set consistent quote types. */
+q { quotes: "\201C" "\201D" "\2018" "\2019"; }
+
+/** Address inconsistent and variable font size in all browsers. */
+q:before, q:after { content: ''; content: none; }
+
+small, .small { font-size: 75%; }
+
+/** Prevent `sub` and `sup` affecting `line-height` in all browsers. */
+sub, sup { font-size: 75%; line-height: 0; position: relative; vertical-align: baseline; }
+
+sup { top: -0.5em; }
+
+sub { bottom: -0.25em; }
+
+/* ========================================================================== Lists
+========================================================================== */
+/* Addresses margins set differently in IE6/7. */
+dl, menu, ol, ul { margin: 1em 0; }
+
+dd { margin: 0; }
+
+/* Addresses paddings set differently in IE6/7. */
+menu { padding: 0 0 0 40px; }
+
+ol, ul { padding: 0; list-style-type: none; }
+
+/* Corrects list images handled incorrectly in IE7. */
+nav ul, nav ol { list-style: none; list-style-image: none; }
+
+/* ========================================================================== Embedded content
+========================================================================== */
+/** Remove border when inside `a` element in IE 8/9. */
+img { border: 0; }
+
+/** Correct overflow displayed oddly in IE 9. */
+svg:not(:root) { overflow: hidden; }
+
+/* ========================================================================== Figures ========================================================================== */
+/** Address margin not present in IE 8/9 and Safari 5. */
+figure { margin: 0; }
+
+/* ========================================================================== Forms ========================================================================== */
+/** Define consistent border, margin, and padding. */
+fieldset { border: 1px solid #c0c0c0; margin: 0 2px; padding: 0.35em 0.625em 0.75em; }
+
+/** 1. Correct `color` not being inherited in IE 8/9. 2. Remove padding so people aren't caught out if they zero out fieldsets. */
+legend { border: 0; /* 1 */ padding: 0; /* 2 */ }
+
+/** 1. Correct font family not being inherited in all browsers. 2. Correct font size not being inherited in all browsers. 3. Address margins set differently in Firefox 4+, Safari 5, and Chrome. */
+button, input, select, textarea { font-family: inherit; /* 1 */ font-size: 100%; /* 2 */ margin: 0; /* 3 */ }
+
+/** Address Firefox 4+ setting `line-height` on `input` using `!important` in the UA stylesheet. */
+button, input { line-height: normal; }
+
+/** Address inconsistent `text-transform` inheritance for `button` and `select`. All other form control elements do not inherit `text-transform` values. Correct `button` style inheritance in Chrome, Safari 5+, and IE 8+. Correct `select` style inheritance in Firefox 4+ and Opera. */
+button, select { text-transform: none; }
+
+/** 1. Avoid the WebKit bug in Android 4.0.* where (2) destroys native `audio` and `video` controls. 2. Correct inability to style clickable `input` types in iOS. 3. Improve usability and consistency of cursor style between image-type `input` and others. */
+button, html input[type="button"], input[type="reset"], input[type="submit"] { -webkit-appearance: button; /* 2 */ cursor: pointer; /* 3 */ }
+
+/** Re-set default cursor for disabled elements. */
+button[disabled], html input[disabled] { cursor: default; }
+
+/** 1. Address box sizing set to `content-box` in IE 8/9/10. 2. Remove excess padding in IE 8/9/10. */
+input[type="checkbox"], input[type="radio"] { box-sizing: border-box; /* 1 */ padding: 0; /* 2 */ }
+
+/** 1. Address `appearance` set to `searchfield` in Safari 5 and Chrome. 2. Address `box-sizing` set to `border-box` in Safari 5 and Chrome (include `-moz` to future-proof). */
+input[type="search"] { -webkit-appearance: textfield; /* 1 */ -moz-box-sizing: content-box; -webkit-box-sizing: content-box; /* 2 */ box-sizing: content-box; }
+
+/** Remove inner padding and search cancel button in Safari 5 and Chrome on OS X. */
+input[type="search"]::-webkit-search-cancel-button, input[type="search"]::-webkit-search-decoration { -webkit-appearance: none; }
+
+/** Remove inner padding and border in Firefox 4+. */
+button::-moz-focus-inner, input::-moz-focus-inner { border: 0; padding: 0; }
+
+/** 1. Remove default vertical scrollbar in IE 8/9. 2. Improve readability and alignment in all browsers. */
+textarea { overflow: auto; /* 1 */ vertical-align: top; /* 2 */ }
+
+/* ========================================================================== Tables ========================================================================== */
+/** Remove most spacing between table cells. */
+table { border-collapse: collapse; border-spacing: 0; }
+
+* { -webkit-box-sizing: border-box; -moz-box-sizing: border-box; box-sizing: border-box; }
+
+.image-replacement, .ir { text-indent: 100%; white-space: nowrap; overflow: hidden; }
+
+.clearfix, .cf, .comment-respond { zoom: 1; }
+.clearfix:before, .clearfix:after, .cf:before, .comment-respond:before, .cf:after, .comment-respond:after { content: ""; display: table; }
+.clearfix:after, .cf:after, .comment-respond:after { clear: both; }
+
+/*
+use the best ampersand
+http://simplebits.com/notebook/2008/08/14/ampersands-2/
+*/
+span.amp { font-family: Baskerville,'Goudy Old Style',Palatino,'Book Antiqua',serif !important; font-style: italic; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Variables
+
+Here is where we declare all our variables like colors, fonts,
+base values, and defaults. We want to make sure this file ONLY
+contains variables that way our files don't get all messy.
+No one likes a mess.
+
+******************************************************************/
+/*********************
+COLORS
+Need help w/ choosing your colors? Try this site out:
+http://0to255.com/
+*********************/
+/*
+Here's a great tutorial on how to
+use color variables properly:
+http://sachagreif.com/sass-color-variables/
+*/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Typography
+
+Need to import a font or set of icons for your site? Drop them in
+here or just use this to establish your typographical grid. Or not.
+Do whatever you want to...GOSH!
+
+Helpful Articles:
+http://trentwalton.com/2012/06/19/fluid-type/
+http://ia.net/blog/responsive-typography-the-basics/
+http://alistapart.com/column/responsive-typography-is-a-physical-discipline
+
+******************************************************************/
+/*********************
+FONT FACE (IN YOUR FACE)
+*********************/
+/* To embed your own fonts, use this syntax and place your fonts inside the library/fonts folder. For more information on embedding fonts, go to: http://www.fontsquirrel.com/ Be sure to remove the comment brackets.
+*/
+/* @font-face { font-family: 'Font Name'; src: url('../css/library/fonts/font-name.eot'); src: url('../css/library/fonts/font-name.eot#iefix') format('embedded-opentype'), url('../css/library/fonts/font-name.woff') format('woff'), url('../css/library/fonts/font-name.ttf') format('truetype'), url('../css/library/fonts/font-name.svg#font-name') format('svg'); font-weight: normal; font-style: normal; }
+*/
+/*
+The following is based of Typebase:
+https://github.com/devinhunt/typebase.css
+I've edited it a bit, but it's a nice starting point.
+*/
+/* i imported this one in the functions file so bones would look sweet. don't forget to remove it for your site.
+*/
+/*
+some nice typographical defaults
+more here: http://www.newnet-soft.com/blog/csstypography
+*/
+p { -ms-word-wrap: break-word; word-break: break-word; word-wrap: break-word; -webkit-hyphens: auto; -moz-hyphens: auto; hyphens: auto; -webkit-hyphenate-before: 2; -webkit-hyphenate-after: 3; hyphenate-lines: 3; -webkit-font-feature-settings: "liga", "dlig"; -moz-font-feature-settings: "liga=1, dlig=1"; -ms-font-feature-settings: "liga", "dlig"; -o-font-feature-settings: "liga", "dlig"; font-feature-settings: "liga", "dlig"; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Sass Functions
+
+You can do a lot of really cool things in Sass. Functions help you
+make repeated actions a lot easier. They are really similar to mixins,
+but can be used for so much more.
+
+Anyway, keep them all in here so it's easier to find when you're
+looking for one.
+
+For more info on functions, go here:
+http://sass-lang.com/documentation/Sass/Script/Functions.html
+
+******************************************************************/
+/*********************
+COLOR FUNCTIONS
+These are helpful when you're working
+with shadows and such things. It's essentially
+a quicker way to write RGBA.
+
+Example:
+box-shadow: 0 0 4px black(0.3);
+compiles to:
+box-shadow: 0 0 4px rgba(0,0,0,0.3);
+*********************/
+/*********************
+RESPONSIVE HELPER FUNCTION
+If you're creating a responsive site, then
+you've probably already read
+Responsive Web Design: http://www.abookapart.com/products/responsive-web-design
+
+Here's a nice little helper function for calculating
+target / context
+as mentioned in that book.
+
+Example:
+width: cp(650px, 1000px);
+or
+width: calc-percent(650px, 1000px);
+both compile to:
+width: 65%;
+*********************/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Mixins Stylesheet
+
+This is where you can take advantage of Sass' great features: Mixins.
+I won't go in-depth on how they work exactly,
+there are a few articles below that will help do that. What I will
+tell you is that this will help speed up simple changes like
+changing a color or adding CSS3 techniques gradients.
+
+A WORD OF WARNING: It's very easy to overdo it here. Be careful and
+remember less is more.
+
+Helpful:
+http://sachagreif.com/useful-sass-mixins/
+http://thesassway.com/intermediate/leveraging-sass-mixins-for-cleaner-code
+http://web-design-weekly.com/blog/2013/05/12/handy-sass-mixins/
+
+******************************************************************/
+/*********************
+TRANSITION
+*********************/
+/*
+I totally rewrote this to be cleaner and easier to use.
+You'll need to be using Sass 3.2+ for these to work.
+Thanks to @anthonyshort for the inspiration on these.
+USAGE: @include transition(all 0.2s ease-in-out);
+*/
+/*********************
+CSS3 GRADIENTS
+Be careful with these since they can
+really slow down your CSS. Don't overdo it.
+*********************/
+/* @include css-gradient(#dfdfdf,#f8f8f8); */
+/*********************
+BOX SIZING
+*********************/
+/* @include box-sizing(border-box); */
+/* NOTE: value of "padding-box" is only supported in Gecko. So
+probably best not to use it. I mean, were you going to anyway? */
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Grid Stylesheet
+
+I've seperated the grid so you can swap it out easily. It's
+called at the top the style.scss stylesheet.
+
+There are a ton of grid solutions out there. You should definitely
+experiment with your own. Here are some recommendations:
+
+http://gridsetapp.com - Love this site. Responsive Grids made easy.
+http://susy.oddbird.net/ - Grids using Compass. Very elegant.
+http://gridpak.com/ - Create your own responsive grid.
+https://github.com/dope/lemonade - Neat lightweight grid.
+
+
+The grid below is a custom built thingy I modeled a bit after
+Gridset. It's VERY basic and probably shouldn't be used on
+your client projects. The idea is you learn how to roll your
+own grids. It's better in the long run and allows you full control
+over your project's layout.
+
+******************************************************************/
+.last-col { float: right; padding-right: 0 !important; }
+
+/*
+Mobile Grid Styles
+These are the widths for the mobile grid.
+There are four types, but you can add or customize
+them however you see fit.
+*/
+@media (max-width: 767px) { .m-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .m-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .m-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .m-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .m-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .m-3of4 { float: left; padding-right: 0.75em; width: 75%; } }
+/* Portrait tablet to landscape */
+@media (min-width: 768px) and (max-width: 1029px) { .t-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .t-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .t-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .t-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .t-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .t-3of4 { float: left; padding-right: 0.75em; width: 75%; }
+ .t-1of5 { float: left; padding-right: 0.75em; width: 20%; }
+ .t-2of5 { float: left; padding-right: 0.75em; width: 40%; }
+ .t-3of5 { float: left; padding-right: 0.75em; width: 60%; }
+ .t-4of5 { float: left; padding-right: 0.75em; width: 80%; } }
+/* Landscape to small desktop */
+@media (min-width: 1030px) { .d-all { float: left; padding-right: 0.75em; width: 100%; padding-right: 0; }
+ .d-1of2 { float: left; padding-right: 0.75em; width: 50%; }
+ .d-1of3 { float: left; padding-right: 0.75em; width: 33.33%; }
+ .d-2of3 { float: left; padding-right: 0.75em; width: 66.66%; }
+ .d-1of4 { float: left; padding-right: 0.75em; width: 25%; }
+ .d-3of4 { float: left; padding-right: 0.75em; width: 75%; }
+ .d-1of5 { float: left; padding-right: 0.75em; width: 20%; }
+ .d-2of5 { float: left; padding-right: 0.75em; width: 40%; }
+ .d-3of5 { float: left; padding-right: 0.75em; width: 60%; }
+ .d-4of5 { float: left; padding-right: 0.75em; width: 80%; }
+ .d-1of6 { float: left; padding-right: 0.75em; width: 16.6666666667%; }
+ .d-1of7 { float: left; padding-right: 0.75em; width: 14.2857142857%; }
+ .d-2of7 { float: left; padding-right: 0.75em; width: 28.5714286%; }
+ .d-3of7 { float: left; padding-right: 0.75em; width: 42.8571429%; }
+ .d-4of7 { float: left; padding-right: 0.75em; width: 57.1428572%; }
+ .d-5of7 { float: left; padding-right: 0.75em; width: 71.4285715%; }
+ .d-6of7 { float: left; padding-right: 0.75em; width: 85.7142857%; }
+ .d-1of8 { float: left; padding-right: 0.75em; width: 12.5%; }
+ .d-1of9 { float: left; padding-right: 0.75em; width: 11.1111111111%; }
+ .d-1of10 { float: left; padding-right: 0.75em; width: 10%; }
+ .d-1of11 { float: left; padding-right: 0.75em; width: 9.09090909091%; }
+ .d-1of12 { float: left; padding-right: 0.75em; width: 8.33%; } }
+/*********************
+IMPORTING MODULES
+Modules are reusable blocks or elements we use throughout the project.
+We can break them up as much as we want or just keep them all in one.
+I mean, you can do whatever you want. The world is your oyster. Unless
+you hate oysters, then the world is your peanut butter & jelly sandwich.
+*********************/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Alert Styles
+
+If you want to use these alerts in your design, you can. If not,
+you can just remove this stylesheet.
+
+******************************************************************/
+.alert-help, .alert-info, .alert-error, .alert-success { margin: 10px; padding: 5px 18px; border: 1px solid; }
+
+.alert-help { border-color: #e8dc59; background: #ebe16f; }
+
+.alert-info { border-color: #bfe4f4; background: #d5edf8; }
+
+.alert-error { border-color: #f8cdce; background: #fbe3e4; }
+
+.alert-success { border-color: #deeaae; background: #e6efc2; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Button Styles
+
+Buttons are a pretty important part of your site's style, so it's
+important to have a consistent baseline for them. Use this stylesheet
+to create all kinds of buttons.
+
+Helpful Links:
+http://galp.in/blog/2011/08/02/the-ui-guide-part-1-buttons/
+
+******************************************************************/
+/*********************
+BUTTON DEFAULTS
+We're gonna use a placeholder selector here
+so we can use common styles. We then use this
+to load up the defaults in all our buttons.
+
+Here's a quick video to show how it works:
+http://www.youtube.com/watch?v=hwdVpKiJzac
+
+*********************/
+.blue-btn, .comment-reply-link, #submit { display: inline-block; position: relative; font-family: "Helvetica Neue", Helvetica, Arial, sans-serif; text-decoration: none; color: white; font-size: 0.9em; font-size: 34px; line-height: 34px; font-weight: normal; padding: 0 24px; border-radius: 4px; border: 0; cursor: pointer; -webkit-transition: background-color 0.14s ease-in-out; transition: background-color 0.14s ease-in-out; }
+.blue-btn:hover, .comment-reply-link:hover, #submit:hover, .blue-btn:focus, .comment-reply-link:focus, #submit:focus { color: white; text-decoration: none; outline: none; }
+.blue-btn:active, .comment-reply-link:active, #submit:active { top: 1px; }
+
+/*
+An example button.
+You can use this example if you want. Just replace all the variables
+and it will create a button dependant on those variables.
+*/
+.blue-btn, .comment-reply-link, #submit { background-color: #2980b9; }
+.blue-btn:hover, .comment-reply-link:hover, #submit:hover, .blue-btn:focus, .comment-reply-link:focus, #submit:focus { background-color: #2574a8; }
+.blue-btn:active, .comment-reply-link:active, #submit:active { background-color: #2472a4; }
+
+.y-btn, .y-btn:visited { background: transparent; padding: 10px 35px; border: 2px solid #f9bf12; color: #f9bf12; text-decoration: none; font-weight: bold; font-family: "Roboto", "Helvetica Neue", Helvetica, Arial, sans-serif; text-transform: uppercase; letter-spacing: 1px; font-size: 10pt; -webkit-transition: all .3s ease; -moz-transition: all .3s ease; -ms-transition: all .3s ease; -o-transition: all .3s ease; transition: all .3s ease; display:block;margin:0 auto 15px;max-width:225px;}
+.y-btn:hover, .y-btn:focus, .y-btn:active, .y-btn:visited:hover, .y-btn:visited:focus, .y-btn:visited:active { background: #f9bf12; color: white; }
+
+.btn-margin { margin-top: 50px; }
+
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Form Styles
+
+We put all the form and button styles in here to setup a consistent
+look. If we need to customize them, we can do this in the main
+stylesheets and just override them. Easy Peasy.
+
+You're gonna see a few data-uri thingies down there. If you're not
+sure what they are, check this link out:
+http://css-tricks.com/data-uris/
+If you want to create your own, use this helpful link:
+http://websemantics.co.uk/online_tools/image_to_data_uri_convertor/
+
+******************************************************************/
+/*********************
+INPUTS
+*********************/
+input[type="text"], input[type="password"], input[type="datetime"], input[type="datetime-local"], input[type="date"], input[type="month"], input[type="time"], input[type="week"], input[type="number"], input[type="email"], input[type="url"], input[type="search"], input[type="tel"], input[type="color"], select, textarea, .field { display: block; height: 40px; line-height: 1em; padding: 0 12px; margin-bottom: 14px; font-size: 1em; color: #5c6b80; border-radius: 3px; vertical-align: middle; [...]
+input[type="text"]:focus, input[type="text"]:active, input[type="password"]:focus, input[type="password"]:active, input[type="datetime"]:focus, input[type="datetime"]:active, input[type="datetime-local"]:focus, input[type="datetime-local"]:active, input[type="date"]:focus, input[type="date"]:active, input[type="month"]:focus, input[type="month"]:active, input[type="time"]:focus, input[type="time"]:active, input[type="week"]:focus, input[type="week"]:active, input[type="number"]:focus, in [...]
+input[type="text"].error, input[type="text"].is-invalid, input[type="password"].error, input[type="password"].is-invalid, input[type="datetime"].error, input[type="datetime"].is-invalid, input[type="datetime-local"].error, input[type="datetime-local"].is-invalid, input[type="date"].error, input[type="date"].is-invalid, input[type="month"].error, input[type="month"].is-invalid, input[type="time"].error, input[type="time"].is-invalid, input[type="week"].error, input[type="week"].is-invalid [...]
+input[type="text"].success, input[type="text"].is-valid, input[type="password"].success, input[type="password"].is-valid, input[type="datetime"].success, input[type="datetime"].is-valid, input[type="datetime-local"].success, input[type="datetime-local"].is-valid, input[type="date"].success, input[type="date"].is-valid, input[type="month"].success, input[type="month"].is-valid, input[type="time"].success, input[type="time"].is-valid, input[type="week"].success, input[type="week"].is-valid [...]
+input[type="text"][disabled], input[type="text"].is-disabled, input[type="password"][disabled], input[type="password"].is-disabled, input[type="datetime"][disabled], input[type="datetime"].is-disabled, input[type="datetime-local"][disabled], input[type="datetime-local"].is-disabled, input[type="date"][disabled], input[type="date"].is-disabled, input[type="month"][disabled], input[type="month"].is-disabled, input[type="time"][disabled], input[type="time"].is-disabled, input[type="week"][d [...]
+input[type="text"][disabled]:focus, input[type="text"][disabled]:active, input[type="text"].is-disabled:focus, input[type="text"].is-disabled:active, input[type="password"][disabled]:focus, input[type="password"][disabled]:active, input[type="password"].is-disabled:focus, input[type="password"].is-disabled:active, input[type="datetime"][disabled]:focus, input[type="datetime"][disabled]:active, input[type="datetime"].is-disabled:focus, input[type="datetime"].is-disabled:active, input[type [...]
+
+input[type="password"] { letter-spacing: 0.3em; }
+
+textarea { max-width: 100%; min-height: 120px; line-height: 1.5em; }
+
+select { -webkit-appearance: none; /* 1 */ -moz-appearance: none; appearance: none; background-image: url(data:image/png;base64,iVBORw0KGgoAAAANSUhEUgAAAA8AAAAHCAYAAADXhRcnAAAAGXRFWHRTb2Z0d2FyZQBBZG9iZSBJbWFnZVJlYWR5ccllPAAAAyRpVFh0WE1MOmNvbS5hZG9iZS54bXAAAAAAADw/eHBhY2tldCBiZWdpbj0i77u/IiBpZD0iVzVNME1wQ2VoaUh6cmVTek5UY3prYzlkIj8+IDx4OnhtcG1ldGEgeG1sbnM6eD0iYWRvYmU6bnM6bWV0YS8iIHg6eG1wdGs9IkFkb2JlIFhNUCBDb3JlIDUuMy1jMDExIDY2LjE0NTY2MSwgMjAxMi8wMi8wNi0xNDo1NjoyNyAgICAgICAgIj4gPHJkZjpSREYg [...]
+
+form#searchform input#searchsubmit { background: transparent url(../images/search.png) top left no-repeat; width: 50px; padding-left: 5px; display: block; overflow: hidden; /* Hack for IE */ text-indent: -9999px; font-size: 0px; line-height: 0px; }
+
+/*********************
+BASE (MOBILE) SIZE
+This are the mobile styles. It's what people see on their phones. If
+you set a great foundation, you won't need to add too many styles in
+the other stylesheets. Remember, keep it light: Speed is Important.
+*********************/
+/******************************************************************
+Site Name:
+Author:
+
+Stylesheet: Base Mobile Stylesheet
+
+Be light and don't over style since everything here will be
+loaded by mobile devices. You want to keep it as minimal as
+possible. This is called at the top of the main stylsheet
+and will be used across all viewports.
+
+******************************************************************/
+/*********************
+GENERAL STYLES
+*********************/
+body { font-family: "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif; font-size: 100%; line-height: 1.5; color: #5c6b80; background-color: #f7f7f7; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-font-smoothing: antialiased; -moz-osx-font-smoothing: grayscale; -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; }
+
+p { -webkit-hyphens: none; -epub-hyphens: none; -moz-hyphens: none; hyphens: none; letter-spacing: 1px; line-height: 1.8em; font-size: 11pt; }
+
+img { max-width: 100%; height: auto; }
+
+.header { box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -webkit-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); -moz-box-shadow: 0 0 10px rgba(0, 0, 0, 0.25); }
+
+/********************
+WORDPRESS BODY CLASSES
+style a page via class
+********************/
+/* for sites that are read right to left (i.e. hebrew) */
+/* home page */
+/* blog template page */
+/* archive page */
+/* date archive page */
+/* replace the number to the corresponding page number */
+/* search page */
+/* search result page */
+/* no results search page */
+/* individual paged search (i.e. body.search-paged-3) */
+/* 404 page */
+/* single post page */
+/* individual post page by id (i.e. body.postid-73) */
+/* individual paged single (i.e. body.single-paged-3) */
+/* attatchment page */
+/* individual attatchment page (i.e. body.attachmentid-763) */
+/* style mime type pages */
+/* author page */
+/* user nicename (i.e. body.author-samueladams) */
+/* paged author archives (i.e. body.author-paged-4) for page 4 */
+/* category page */
+/* individual category page (i.e. body.category-6) */
+/* replace the number to the corresponding page number */
+/* tag page */
+/* individual tag page (i.e. body.tag-news) */
+/* replace the number to the corresponding page number */
+/* custom page template page */
+/* individual page template (i.e. body.page-template-contact-php */
+/* replace the number to the corresponding page number */
+/* parent page template */
+/* child page template */
+/* replace the number to the corresponding page number */
+/* if user is logged in */
+/* paged items like search results or archives */
+/* individual paged (i.e. body.paged-3) */
+/*********************
+LAYOUT & GRID STYLES
+*********************/
+.wrap { width: 85%; margin: 0 auto; }
+
+.center { text-align: center; }
+
+.table { display: table; border-collapse: separate; }
+
+.table-row { display: table-row; }
+
+.table-cell { display: table-cell; vertical-align: middle; }
+
+.table-cell.quote-man {padding-right:35px;text-align:center;min-width:140px;}
+
+.disclaimer {color:#fff;font-size:.7em;line-height:1.3em;}
+
+/*********************
+LINK STYLES
+*********************/
+a, a:visited { color: #f9bf12; -webkit-transition: color .3s ease; -moz-transition: color .3s ease; -ms-transition: color .3s ease; -o-transition: color .3s ease; transition: color .3s ease; text-decoration: none; /* on hover */ /* on click */ /* mobile tap color */ }
+a:hover, a:focus, a:visited:hover, a:visited:focus { color: #3e3e40; }
+a:link, a:visited:link { /*
+this highlights links on iPhones/iPads.
+so it basically works like the :hover selector
+for mobile devices.
+*/ -webkit-tap-highlight-color: rgba(0, 0, 0, 0.3); }
+
+/******************************************************************
+H1, H2, H3, H4, H5 STYLES
+******************************************************************/
+h1, .h1, h2, .h2, h3, .h3, h4, .h4, h5, .h5 { text-rendering: optimizelegibility; font-weight: 500; color: #f9bf12; /*
+if you're going to use webfonts, be sure to check your weights
+http://css-tricks.com/watch-your-font-weight/
+*/ /* removing text decoration from all headline links */ }
+h1 a, .h1 a, h2 a, .h2 a, h3 a, .h3 a, h4 a, .h4 a, h5 a, .h5 a { text-decoration: none; }
+
+h1, .h1 { font-size: 2.2em; line-height: 1.333em; }
+
+h2, .h2 { font-size: 1.75em; line-height: 1.4em; margin-bottom: 0.375em; }
+
+h3, .h3 { font-size: 1.125em; }
+
+h4, .h4 { font-size: 1.1em; font-weight: 700; }
+
+h5, .h5 { font-size: 0.846em; line-height: 2.09em; text-transform: uppercase; letter-spacing: 2px; }
+
+/*********************
+HEADER STYLES
+*********************/
+.header { background-color: white; }
+
+#logo { margin: 25px 0 15px; text-align: center; }
+#logo a { color: white; }
+
+#masthead { background: url("../images/masthead-bg.png") no-repeat center center; background-size: cover; clear: both; padding: 50px 0; -webkit-box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); box-shadow: inset 0 0 5px 8px rgba(0, 0, 0, 0.2); text-align: center; }
+#masthead h1 { color: #f9bf12; line-height: 1.2em; max-width: 390px; text-align: center; display: block; margin: 0 auto; }
+#masthead p { color: #fff; line-height: 1.8em; text-align: center; letter-spacing: 1px; font-size: 11pt; }
+
+/*********************
+NAVIGATION STYLES
+*********************/
+/*
+all navs have a .nav class applied via
+the wp_menu function; this is so we can
+easily write one group of styles for
+the navs on the site so our css is cleaner
+and more scalable.
+*/
+.nav { border-bottom: 0; margin: 0; font-family: "Roboto", "Helvetica Neue", Helvetica, Arial, sans-serif; /* end .menu li */ /* highlight current page */ /* end current highlighters */ }
+.nav li { /*
+so you really have to rethink your dropdowns for mobile.
+you don't want to have it expand too much because the
+screen is so small. How you manage your menu should
+depend on the project. Here's some great info on it:
+http://www.alistapart.com/articles/organizing-mobile/
+*/ }
+.nav li a { display: block; color: white; text-decoration: none; padding: 0.75em; /*
+remember this is for mobile ONLY, so there's no need
+to even declare hover styles here, you can do it in
+the style.scss file where it's relevant. We want to
+keep this file as small as possible!
+*/ }
+.nav li ul.sub-menu li a, .nav li ul.children li a { padding-left: 30px; }
+
+/* end .nav */
+/*********************
+POSTS & CONTENT STYLES
+*********************/
+.home { background: white; }
+.home #main img { margin: 50px 0; }
+.home .header { box-shadow: none; -webkit-box-shadow: none; -moz-box-shadow: none; }
+
+#and { background: #3e3e40; padding: 25px 0; color: #fff; }
+
+#how-it-works { padding: 50px 0 100px; background: #efefef; text-align: center; border-bottom: 1px solid #e0e0e0; }
+#how-it-works img { display: block; margin: 50px auto 0; }
+
+#key-features { padding: 50px 0; background: white url("../images/key_features_bg.jpg") no-repeat top center; background-size: cover; border-top: 1px solid #efefef; }
+#key-features .d-1of2 { margin: 25px 0; }
+#key-features h1 { text-align: center; margin: 0 0 50px; }
+#key-features h3 { font-weight: bold; max-width: 200px; line-height: 1em; font-size: 16pt; font-weight: 600; }
+#key-features img { margin-right: 20px; }
+#key-features .btn-margin { clear: both; text-align: center; }
+
+#user-stories { background: #535457; padding: 50px 0; color: #fff; }
+#user-stories h1 { text-align: center; }
+#user-stories .intro { background: url("../images/quotes.png") no-repeat center center; text-align: center; font-weight: 600; padding: 25px 0; }
+#user-stories .table { margin-bottom: 25px; border-bottom: 1px solid #7e7f81; vertical-align: middle; }
+#user-stories .table:last-of-type { border-bottom: none; }
+#user-stories .table-cell { width: 100%; display: block; text-align: center; margin-bottom: 25px; }
+#user-stories .quote-man { text-align: center; width: 100%; }
+#user-stories .quote-man h3 { margin: 10px 0 20px; }
+
+#use-case { padding: 50px 0; background: #efefef; }
+#use-case h1 { text-align: center; margin-bottom: 0; }
+#use-case h3 { color: #535457; text-align: center; font-weight: 800; font-family: "Roboto", "Helvetica Neue", Helvetica, Arial, sans-serif; letter-spacing: 1px; margin: 10px 0 75px; font-size: 16pt; }
+#use-case .number { min-height: 100px; width: 95px; vertical-align: top; }
+#use-case .left img { margin-bottom: 50px; }
+#use-case .table { padding: 25px 0 25px 0; }
+#use-case .table:first-of-type { padding-top: 0; }
+#use-case .table p { font-size: 13pt; line-height: 1.3em; font-weight: 600; }
+#use-case .table p strong { font-weight: 800; }
+#use-case .table p:first-of-type { margin-top: 0; }
+
+.arrow { margin: 50px 0 0; width: 100%; height: 150px; background-color: #f9bf12; position: relative; }
+.arrow p { margin: 20px 25px 20px 25px; font-size: 14pt; text-align: left; line-height: 1.2em; }
+
+#more-info { background: #535457; padding: 50px 0; }
+#more-info p { text-align: center; }
+
+.social-icons {text-align:center;margin-bottom:50px;}
+.social-icons a {font-size:2em;}
+.social-icons a:hover {color:#fff;}
+.social-icons a:first-child {margin-right:15px;}
+
+#content { margin-top: 2em; }
+
+.hentry { padding: .75em; margin-bottom: 1.5em; }
+.hentry footer { padding: 1.5em 0; border-top: 1px solid #d6d6d6; }
+.hentry footer p { margin: 0; }
+
+/* end .hentry */
+.single-title, .page-title, .entry-title { margin: 0; }
+
+/* want to style individual post classes? Booya! */
+/* post by id (i.e. post-3) */
+/* general post style */
+/* general article on a page style */
+/* general style on an attatchment */
+/* sticky post style */
+/* hentry class */
+/* style by category (i.e. category-videos) */
+/* style by tag (i.e. tag-news) */
+/* post meta */
+.byline { color: #9fa6b4; margin: 0; font-size: 10pt; }
+
+/* entry content */
+.entry-content { padding: 1.5em 0; /*
+image alignment on a screen this size may be
+a bit difficult. It's set to start aligning
+and floating images at the next breakpoint,
+but it's up to you. Feel free to change it up.
+*/ }
+.entry-content ol {list-style-type:decimal;padding-left:40px;}
+.entry-content ul {list-style-type:disc;padding-left:40px;}
+.entry-content p { margin: 0 0 1.5em; }
+.entry-content table { width: 100%; border: 1px solid #626366; margin-bottom: 1.5em; }
+.entry-content table caption { margin: 0 0 7px; font-size: 0.75em; color: #9fa6b4; text-transform: uppercase; letter-spacing: 1px; }
+.entry-content tr { border-bottom: 1px solid #626366; }
+.entry-content tr:nth-child(even) { background-color: #f8f9fa; }
+.entry-content td { padding: 7px; border-right: 1px solid #626366; }
+.entry-content td:last-child { border-right: 0; }
+.entry-content th { background-color: #f8f9fa; border-bottom: 1px solid #626366; border-right: 1px solid #626366; }
+.entry-content th:last-child { border-right: 0; }
+.entry-content blockquote { margin: 0 0 1.5em 0.75em; padding: 0 0 0 0.75em; border-left: 3px solid #2980b9; font-style: italic; color: #9fa6b4; }
+.entry-content dd { margin-left: 0; font-size: 0.9em; color: #787878; margin-bottom: 1.5em; }
+.entry-content img { margin: 0 0 1.5em 0; max-width: 100%; height: auto; }
+.entry-content .size-auto, .entry-content .size-full, .entry-content .size-large, .entry-content .size-medium, .entry-content .size-thumbnail { max-width: 100%; height: auto; }
+.entry-content pre { background: #323944; color: #f8f9fa; font-size: 0.9em; padding: 1.5em; margin: 0 0 1.5em; border-radius: 3px; }
+
+/* end .entry-content */
+.wp-caption { max-width: 100%; background: #eee; padding: 5px; /* images inside wp-caption */ }
+.wp-caption img { max-width: 100%; margin-bottom: 0; width: 100%; }
+.wp-caption p.wp-caption-text { font-size: 0.85em; margin: 4px 0 7px; text-align: center; }
+
+/* end .wp-caption */
+/* image gallery styles */
+/* end .gallery */
+/* gallery caption styles */
+.tags { margin: 0; }
+
+/******************************************************************
+PAGE NAVI STYLES
+******************************************************************/
+.pagination, .wp-prev-next { margin: 1.5em 0; }
+
+.pagination { text-align: center; }
+.pagination ul { display: inline-block; white-space: nowrap; padding: 0; clear: both; border-radius: 3px; }
+.pagination li { padding: 0; margin: 0; float: left; display: inline; overflow: hidden; border-right: 1px solid #9fa6b4; }
+.pagination a, .pagination span { margin: 0; text-decoration: none; padding: 0; line-height: 1em; font-size: 1em; font-weight: normal; padding: 0.75em; min-width: 1em; display: block; color: #f9bf12; }
+.pagination a:hover, .pagination a:focus, .pagination span:hover, .pagination span:focus { background-color: #f9bf12; color: white; }
+.pagination .current { cursor: default; color: #9fa6b4; }
+.pagination .current:hover, .pagination .current:focus { background-color: transparent; color: #5c6b80; }
+
+/* end .bones_page_navi */
+/* fallback previous & next links */
+.wp-prev-next .prev-link { float: left; }
+.wp-prev-next .next-link { float: right; }
+
+/* end .wp-prev-next */
+/******************************************************************
+COMMENT STYLES
+******************************************************************/
+/* h3 comment title */
+#comments-title { padding: 0.75em; margin: 0; border-top: 1px solid #f8f9fa; /* number of comments span */ }
+
+.commentlist { margin: 0; list-style-type: none; }
+
+.comment { position: relative; clear: both; overflow: hidden; padding: 1.5em; border-bottom: 1px solid #f8f9fa; /* vcard */ /* end .commentlist .vcard */ /* end children */ /* general comment classes */ }
+.comment .comment-author { padding: 7px; border: 0; }
+.comment .vcard { margin-left: 50px; }
+.comment .vcard cite.fn { font-weight: 700; font-style: normal; }
+.comment .vcard time { display: block; font-size: 0.9em; font-style: italic; }
+.comment .vcard time a { color: #9fa6b4; text-decoration: none; }
+.comment .vcard time a:hover { text-decoration: underline; }
+.comment .vcard .avatar { position: absolute; left: 16px; border-radius: 50%; }
+.comment:last-child { margin-bottom: 0; }
+.comment .children { margin: 0; /* variations */ /* change number for different depth */ }
+.comment[class*=depth-] { margin-top: 1.1em; }
+.comment.depth-1 { margin-left: 0; margin-top: 0; }
+.comment:not(.depth-1) { margin-top: 0; margin-left: 7px; padding: 7px; }
+.comment.odd { background-color: white; }
+.comment.even { background: #f8f9fa; }
+
+/* comment meta */
+/* comment content */
+.comment_content p { margin: 0.7335em 0 1.5em; font-size: 1em; line-height: 1.5em; }
+
+/* end .commentlist .comment_content */
+/* comment reply link */
+.comment-reply-link { font-size: 0.9em; float: right; }
+
+/* end .commentlist .comment-reply-link */
+/* edit comment link */
+.comment-edit-link { font-style: italic; margin: 0 7px; text-decoration: none; font-size: 0.9em; }
+
+/******************************************************************
+COMMENT FORM STYLES
+******************************************************************/
+.comment-respond { padding: 1.5em; border-top: 1px solid #f8f9fa; }
+
+#reply-title { margin: 0; }
+
+.logged-in-as { color: #9fa6b4; font-style: italic; margin: 0; }
+.logged-in-as a { color: #5c6b80; }
+
+.comment-form-comment { margin: 1.5em 0 0.75em; }
+
+.form-allowed-tags { padding: 1.5em; background-color: #f8f9fa; font-size: 0.9em; }
+
+/* comment submit button */
+#submit { float: right; font-size: 1em; }
+
+/* comment form title */
+#comment-form-title { margin: 0 0 1.1em; }
+
+/* cancel comment reply link */
+/* logged in comments */
+/* allowed tags */
+#allowed_tags { margin: 1.5em 10px 0.7335em 0; }
+
+/* no comments */
+.nocomments { margin: 0 20px 1.1em; }
+
+/*********************
+SIDEBARS & ASIDES
+*********************/
+.widget ul li { /* deep nesting */ }
+
+.no-widgets { background-color: white; padding: 1.5em; text-align: center; border: 1px solid #cccccc; border-radius: 2px; margin-bottom: 1.5em; }
+
+/*********************
+FOOTER STYLES
+*********************/
+.footer { clear: both; background-color: #3e3e40; color: #f8f9fa; min-height: 50px; }
+
+/*
+if you checked out the link above:
+http://www.alistapart.com/articles/organizing-mobile/
+you'll want to style the footer nav
+a bit more in-depth. Remember to keep
+it simple because you'll have to
+override these styles for the desktop
+view.
+*/
+/* end .footer-links */
+/*********************
+LARGER MOBILE DEVICES
+This is for devices like the Galaxy Note or something that's
+larger than an iPhone but smaller than a tablet. Let's call them
+tweeners.
+*********************/
+@media only screen and (min-width: 481px) { /****************************************************************** Site Name: Author: Stylesheet: 481px and Up Stylesheet This stylesheet is loaded for larger devices. It's set to 481px because at 480px it would load on a landscaped iPhone. This isn't ideal because then you would be loading all those extra styles on that same mobile connection. A word of warning. This size COULD be a larger mobile device, so you still want to keep it pretty [...]
+ /* IMPORTANT NOTE ABOUT SASS 3.3 & UP You can't use @extend within media queries anymore, so just be aware that if you drop them in here, they won't work. */
+ /********************* NAVIGATION STYLES ********************/
+ /* .menu is clearfixed inside mixins.scss */
+ .menu { /* end .menu ul */ }
+ .menu ul { /* end .menu ul li */ /* highlight current page */ /* end current highlighters */ }
+ .menu ul li { /*
+plan your menus and drop-downs wisely.
+*/ }
+ .menu ul li a { /*
+you can use hover styles here even though this size
+has the possibility of being a mobile device.
+*/ }
+ /* end .menu */
+ /********************* POSTS & CONTENT STYLES ********************/
+ #user-stories .table-cell { width: auto; display: table-cell; text-align: left; }
+ #user-stories .quote-man { text-align: center; width: 200px; }
+ .arrow { margin: 50px 0 0; width: 85%; height: 130px; background-color: #f9bf12; position: relative; }
+ .arrow p { margin: 20px 25px 20px 25px; font-size: 14pt; text-align: left; line-height: 1.2em; }
+ .arrow:after { content: ''; position: absolute; top: 0px; left: 100%; width: 0; height: 0; border: 65px solid transparent; border-left: 55px solid #f9bf12; }
+ /* entry content */
+ .entry-content { /* at this larger size, we can start to align images */ }
+ .entry-content .alignleft, .entry-content img.alignleft { margin-right: 1.5em; display: inline; float: left; }
+ .entry-content .alignright, .entry-content img.alignright { margin-left: 1.5em; display: inline; float: right; }
+ .entry-content .aligncenter, .entry-content img.aligncenter { margin-right: auto; margin-left: auto; display: block; clear: both; }
+ /* end .entry-content */
+ /********************* FOOTER STYLES ********************/
+ /* check your menus here. do they look good? do they need tweaking? */
+ /* end .footer-links */ }
+/*********************
+TABLET & SMALLER LAPTOPS
+This is the average viewing window. So Desktops, Laptops, and
+in general anyone not viewing on a mobile device. Here's where
+you can add resource intensive styles.
+*********************/
+@media only screen and (min-width: 768px) { /****************************************************************** Site Name: Author: Stylesheet: Tablet & Small Desktop Stylesheet Here's where you can start getting into the good stuff. This size will work on iPads, other tablets, and desktops. So you can start working with more styles, background images, and other resources. You'll also notice the grid starts to come into play. Have fun! ************************************************** [...]
+ /********************* GENERAL STYLES ********************/
+ /********************* LAYOUT & GRID STYLES ********************/
+ .wrap { width: 760px; }
+ /********************* HEADER STYLES ********************/
+ #logo { float: left; text-align: left; }
+ img.oniguy { margin-top: 100px; }
+ .oni-guy { float: right; }
+ #masthead { text-align: left; }
+ #masthead h1 { text-align: left; margin: 0; }
+ #masthead p { text-align: left; }
+ /********************* NAVIGATION STYLES ********************/
+ .nav { border: 0; float: right; margin-top: 35px; /* end .menu ul li */ /* highlight current page */ /* end current highlighters */ }
+ .nav ul { background: #323944; margin-top: 0; }
+ .nav li { float: left; position: relative; /*
+plan your menus and drop-downs wisely.
+*/ /* showing sub-menus */ }
+ .nav li a { border-bottom: 0; color: #626366; font-family: "Roboto", "Helvetica Neue", Helvetica, Arial, sans-serif; font-weight: 600; text-transform: uppercase; font-size: 10pt; letter-spacing: 1px; padding: .75em 1.5em; /*
+you can use hover styles here even though this size
+has the possibility of being a mobile device.
+*/ }
+ .nav li a:hover, .nav li a:focus { color: #f9bf12; }
+ .nav li ul.sub-menu, .nav li ul.children { margin-top: 0; border: 1px solid #ccc; border-top: 0; position: absolute; visibility: hidden; z-index: 8999; /* highlight sub-menu current page */ }
+ .nav li ul.sub-menu li, .nav li ul.children li { /*
+if you need to go deeper, go nuts
+just remember deeper menus suck
+for usability. k, bai.
+*/ }
+ .nav li ul.sub-menu li a, .nav li ul.children li a { padding-left: 10px; border-right: 0; display: block; width: 180px; border-bottom: 1px solid #ccc; }
+ .nav li ul.sub-menu li:last-child a, .nav li ul.children li:last-child a { border-bottom: 0; }
+ .nav li ul.sub-menu li ul, .nav li ul.children li ul { top: 0; left: 100%; }
+ .nav li:hover > ul { top: auto; visibility: visible; }
+ /* end .nav */
+ /********************* CONTENT ********************/
+ #how-it-works { padding: 100px 0; text-align: left; }
+ #how-it-works img { display: block; margin: 0 auto; }
+ #key-features .d-1of2:nth-of-type(2n+1) { clear: both; }
+ #key-features .d-1of2 p { margin-right: 35px; }
+ #use-case .table { padding: 25px 0 25px 50px; border-left: 1px solid #535457; }
+ #use-case .table:first-of-type { padding-top: 0; }
+ #use-case .table:last-of-type { padding-bottom: 0; }
+ #use-case .left img { margin-bottom: 0; padding-right: 25px; }
+ .arrow { height: 80px; }
+ .arrow p { margin: 20px 85px 20px 25px; }
+ .arrow:after { border: 40px solid transparent; border-left: 40px solid #f9bf12; }
+ .hentry { margin-right: 50px; }
+ /********************* SIDEBARS & ASIDES ********************/
+ .sidebar { margin-top: 0; }
+ .widgettitle { border-bottom: 2px solid #444; margin-bottom: 0.75em; }
+ .widget { padding: 0 10px; margin: 2.2em 0; }
+ .widget ul li { margin-bottom: 0.75em; /* deep nesting */ }
+ .widget ul li ul { margin-top: 0.75em; padding-left: 1em; }
+ /* links widget */
+ /* meta widget */
+ /* pages widget */
+ /* recent-posts widget */
+ /* archives widget */
+ /* tag-cloud widget */
+ /* calendar widget */
+ /* category widget */
+ /* recent-comments widget */
+ /* search widget */
+ /* text widget */
+ /********************* FOOTER STYLES ********************/
+ /* you'll probably need to do quite a bit of overriding here if you styled them for mobile. Make sure to double check these! */
+ .footer-links ul li { /*
+be careful with the depth of your menus.
+it's very rare to have multi-depth menus in
+the footer.
+*/ }
+.y-btn {display:inline-block;margin:0;}
+/*.y-btn:first-of-type {margin-right:15px;}*/
+ /* end .footer-links */ }
+/*********************
+DESKTOP
+This is the average viewing window. So Desktops, Laptops, and
+in general anyone not viewing on a mobile device. Here's where
+you can add resource intensive styles.
+*********************/
+@media only screen and (min-width: 1030px) { /****************************************************************** Site Name: Author: Stylesheet: Desktop Stylsheet This is the desktop size. It's larger than an iPad so it will only be seen on the Desktop. *****************************************************************/
+ .wrap { width: 1040px; }
+ .nav li a { padding: .75em 2em; }
+ img.oniguy { margin-top: 75px; }
+ #and { display: table; border-collapse: separate; width: 100%; }
+ #and .and-row { display: table-row; }
+ #and .and-cell { display: table-cell; vertical-align: bottom; }
+ #and p { margin: 0; }
+ #and img { margin-right: 35px; }
+ #use-case .table:last-of-type { padding-bottom: 125px; }
+ .arrow { height: 80px; }
+ .arrow p { margin: 30px 60px 20px 25px; }
+ .arrow:after { border: 40px solid transparent; border-left: 40px solid #f9bf12; } }
+/*********************
+LARGE VIEWING SIZE
+This is for the larger monitors and possibly full screen viewers.
+*********************/
+@media only screen and (min-width: 1240px) { /****************************************************************** Site Name: Author: Stylesheet: Super Large Monitor Stylesheet You can add some advanced styles here if you like. This kicks in on larger screens. *****************************************************************/ }
+/*********************
+RETINA (2x RESOLUTION DEVICES)
+This applies to the retina iPhone (4s) and iPad (2,3) along with
+other displays with a 2x resolution. You can also create a media
+query for retina AND a certain size if you want. Go Nuts.
+*********************/
+@media only screen and (-webkit-min-device-pixel-ratio: 1.5), only screen and (min--moz-device-pixel-ratio: 1.5), only screen and (min-device-pixel-ratio: 1.5) { /****************************************************************** Site Name: Author: Stylesheet: Retina Screens & Devices Stylesheet When handling retina screens you need to make adjustments, especially if you're not using font icons. Here you can add them in one neat place. *********************************************** [...]
+ /* EXAMPLE Let's say you have an image and you need to make sure it looks ok on retina screens. Let's say we have an icon which dimension are 24px x 24px. In your regular stylesheets, it would look something like this: .icon { width: 24px; height: 24px; background: url(../css/img/test.png) no-repeat; } For retina screens, we have to make some adjustments, so that image doesn't look blurry. So, taking into account the image above and the dimensions, this is what we would put in [...]
+/*********************
+PRINT STYLESHEET
+Feel free to customize this. Remember to add things that won't make
+sense to print at the bottom. Things like nav, ads, and forms should
+be set to display none.
+*********************/
+@media print { /****************************************************************** Site Name: Author: Stylesheet: Print Stylesheet This is the print stylesheet. There's probably not a lot of reasons to edit this stylesheet. If you want to though, go for it. *****************************************************************/
+ * { background: transparent !important; color: black !important; text-shadow: none !important; filter: none !important; -ms-filter: none !important; }
+ a, a:visited { color: #444 !important; text-decoration: underline; }
+ a:after, a:visited:after { content: " (" attr(href) ")"; }
+ a abbr[title]:after, a:visited abbr[title]:after { content: " (" attr(title) ")"; }
+ .ir a:after, a[href^="javascript:"]:after, a[href^="#"]:after { content: ""; }
+ pre, blockquote { border: 1px solid #999; page-break-inside: avoid; }
+ thead { display: table-header-group; }
+ tr, img { page-break-inside: avoid; }
+ img { max-width: 100% !important; }
+ @page { margin: 0.5cm; }
+ p, h2, h3 { orphans: 3; widows: 3; }
+ h2, h3 { page-break-after: avoid; }
+ .sidebar, .page-navigation, .wp-prev-next, .respond-form, nav { display: none; } }
diff --git a/wp-content/themes/oni/library/fonts/icomoon.eot b/wp-content/themes/oni/library/fonts/icomoon.eot
new file mode 100644
index 0000000..eab027a
Binary files /dev/null and b/wp-content/themes/oni/library/fonts/icomoon.eot differ
diff --git a/wp-content/themes/oni/library/fonts/icomoon.svg b/wp-content/themes/oni/library/fonts/icomoon.svg
new file mode 100644
index 0000000..d9d34b2
--- /dev/null
+++ b/wp-content/themes/oni/library/fonts/icomoon.svg
@@ -0,0 +1,13 @@
+<?xml version="1.0" standalone="no"?>
+<!DOCTYPE svg PUBLIC "-//W3C//DTD SVG 1.1//EN" "http://www.w3.org/Graphics/SVG/1.1/DTD/svg11.dtd" >
+<svg xmlns="http://www.w3.org/2000/svg">
+<metadata>Generated by IcoMoon</metadata>
+<defs>
+<font id="icomoon" horiz-adv-x="1024">
+<font-face units-per-em="1024" ascent="960" descent="-64" />
+<missing-glyph horiz-adv-x="1024" />
+<glyph unicode=" " horiz-adv-x="512" d="" />
+<glyph unicode="" glyph-name="twitter" horiz-adv-x="951" d="M925.714 717.714q-38.286-56-92.571-95.429 0.571-8 0.571-24 0-74.286-21.714-148.286t-66-142-105.429-120.286-147.429-83.429-184.571-31.143q-154.857 0-283.429 82.857 20-2.286 44.571-2.286 128.571 0 229.143 78.857-60 1.143-107.429 36.857t-65.143 91.143q18.857-2.857 34.857-2.857 24.571 0 48.571 6.286-64 13.143-106 63.714t-42 117.429v2.286q38.857-21.714 83.429-23.429-37.714 25.143-60 65.714t-22.286 88q0 50.286 25.143 93.143 69 [...]
+<glyph unicode="" glyph-name="envelop" d="M928 832h-832c-52.8 0-96-43.2-96-96v-640c0-52.8 43.2-96 96-96h832c52.8 0 96 43.2 96 96v640c0 52.8-43.2 96-96 96zM398.74 409.628l-270.74-210.892v501.642l270.74-290.75zM176.38 704h671.24l-335.62-252-335.62 252zM409.288 398.302l102.712-110.302 102.71 110.302 210.554-270.302h-626.528l210.552 270.302zM625.26 409.628l270.74 290.75v-501.642l-270.74 210.892z" />
+<glyph unicode="" glyph-name="envelope" d="M1024 545.143v-453.714q0-37.714-26.857-64.571t-64.571-26.857h-841.143q-37.714 0-64.571 26.857t-26.857 64.571v453.714q25.143-28 57.714-49.714 206.857-140.571 284-197.143 32.571-24 52.857-37.429t54-27.429 62.857-14h1.143q29.143 0 62.857 14t54 27.429 52.857 37.429q97.143 70.286 284.571 197.143 32.571 22.286 57.143 49.714zM1024 713.143q0-45.143-28-86.286t-69.714-70.286q-214.857-149.143-267.429-185.714-5.714-4-24.286-17.429t-30.857-21.714-29. [...]
+</font></defs></svg>
\ No newline at end of file
diff --git a/wp-content/themes/oni/library/fonts/icomoon.ttf b/wp-content/themes/oni/library/fonts/icomoon.ttf
new file mode 100644
index 0000000..fb19d39
Binary files /dev/null and b/wp-content/themes/oni/library/fonts/icomoon.ttf differ
diff --git a/wp-content/themes/oni/library/fonts/icomoon.woff b/wp-content/themes/oni/library/fonts/icomoon.woff
new file mode 100644
index 0000000..c9238a0
Binary files /dev/null and b/wp-content/themes/oni/library/fonts/icomoon.woff differ
diff --git a/wp-content/themes/oni/library/images/and.png b/wp-content/themes/oni/library/images/and.png
new file mode 100644
index 0000000..8b6164b
Binary files /dev/null and b/wp-content/themes/oni/library/images/and.png differ
diff --git a/wp-content/themes/oni/library/images/apache-incubator.png b/wp-content/themes/oni/library/images/apache-incubator.png
new file mode 100644
index 0000000..0b44446
Binary files /dev/null and b/wp-content/themes/oni/library/images/apache-incubator.png differ
diff --git a/wp-content/themes/oni/library/images/apple-touch-icon.png b/wp-content/themes/oni/library/images/apple-touch-icon.png
new file mode 100644
index 0000000..6c9b524
Binary files /dev/null and b/wp-content/themes/oni/library/images/apple-touch-icon.png differ
diff --git a/wp-content/themes/oni/library/images/key_features_bg.jpg b/wp-content/themes/oni/library/images/key_features_bg.jpg
new file mode 100644
index 0000000..68b0a42
Binary files /dev/null and b/wp-content/themes/oni/library/images/key_features_bg.jpg differ
diff --git a/wp-content/themes/oni/library/images/logo.png b/wp-content/themes/oni/library/images/logo.png
new file mode 100644
index 0000000..1bf9f68
Binary files /dev/null and b/wp-content/themes/oni/library/images/logo.png differ
diff --git a/wp-content/themes/oni/library/images/masthead-bg.png b/wp-content/themes/oni/library/images/masthead-bg.png
new file mode 100644
index 0000000..afcf7be
Binary files /dev/null and b/wp-content/themes/oni/library/images/masthead-bg.png differ
diff --git a/wp-content/themes/oni/library/images/quote-person.png b/wp-content/themes/oni/library/images/quote-person.png
new file mode 100644
index 0000000..ed82e8d
Binary files /dev/null and b/wp-content/themes/oni/library/images/quote-person.png differ
diff --git a/wp-content/themes/oni/library/images/quotes.png b/wp-content/themes/oni/library/images/quotes.png
new file mode 100644
index 0000000..05c91ab
Binary files /dev/null and b/wp-content/themes/oni/library/images/quotes.png differ
diff --git a/wp-content/themes/oni/library/images/search.png b/wp-content/themes/oni/library/images/search.png
new file mode 100644
index 0000000..985e83e
Binary files /dev/null and b/wp-content/themes/oni/library/images/search.png differ
diff --git a/wp-content/themes/oni/library/js/jquery.meanmenu.js b/wp-content/themes/oni/library/js/jquery.meanmenu.js
new file mode 100644
index 0000000..873d459
--- /dev/null
+++ b/wp-content/themes/oni/library/js/jquery.meanmenu.js
@@ -0,0 +1,285 @@
+/*!
+* jQuery meanMenu v2.0.8
+* @Copyright (C) 2012-2014 Chris Wharton @ MeanThemes (https://github.com/meanthemes/meanMenu)
+*
+*/
+/*
+* This program is free software: you can redistribute it and/or modify
+* it under the terms of the GNU General Public License as published by
+* the Free Software Foundation, either version 3 of the License, or
+* (at your option) any later version.
+*
+* THIS SOFTWARE AND DOCUMENTATION IS PROVIDED "AS IS," AND COPYRIGHT
+* HOLDERS MAKE NO REPRESENTATIONS OR WARRANTIES, EXPRESS OR IMPLIED,
+* INCLUDING BUT NOT LIMITED TO, WARRANTIES OF MERCHANTABILITY OR
+* FITNESS FOR ANY PARTICULAR PURPOSE OR THAT THE USE OF THE SOFTWARE
+* OR DOCUMENTATION WILL NOT INFRINGE ANY THIRD PARTY PATENTS,
+* COPYRIGHTS, TRADEMARKS OR OTHER RIGHTS.COPYRIGHT HOLDERS WILL NOT
+* BE LIABLE FOR ANY DIRECT, INDIRECT, SPECIAL OR CONSEQUENTIAL
+* DAMAGES ARISING OUT OF ANY USE OF THE SOFTWARE OR DOCUMENTATION.
+*
+* You should have received a copy of the GNU General Public License
+* along with this program. If not, see <http://gnu.org/licenses/>.
+*
+* Find more information at http://www.meanthemes.com/plugins/meanmenu/
+*
+*/
+(function ($) {
+ "use strict";
+ $.fn.meanmenu = function (options) {
+ var defaults = {
+ meanMenuTarget: jQuery(this), // Target the current HTML markup you wish to replace
+ meanMenuContainer: '#mobile-nav', // Choose where meanmenu will be placed within the HTML
+ meanMenuClose: "X", // single character you want to represent the close menu button
+ meanMenuCloseSize: "18px", // set font size of close button
+ meanMenuOpen: "<span /><span /><span />", // text/markup you want when menu is closed
+ meanRevealPosition: "right", // left right or center positions
+ meanRevealPositionDistance: "0", // Tweak the position of the menu
+ meanRevealColour: "", // override CSS colours for the reveal background
+ meanScreenWidth: "1030", // set the screen width you want meanmenu to kick in at
+ meanNavPush: "", // set a height here in px, em or % if you want to budge your layout now the navigation is missing.
+ meanShowChildren: true, // true to show children in the menu, false to hide them
+ meanExpandableChildren: true, // true to allow expand/collapse children
+ meanExpand: "+", // single character you want to represent the expand for ULs
+ meanContract: "-", // single character you want to represent the contract for ULs
+ meanRemoveAttrs: false, // true to remove classes and IDs, false to keep them
+ onePage: false, // set to true for one page sites
+ meanDisplay: "block", // override display method for table cell based layouts e.g. table-cell
+ removeElements: "" // set to hide page elements
+ };
+ options = $.extend(defaults, options);
+
+ // get browser width
+ var currentWidth = window.innerWidth || document.documentElement.clientWidth;
+
+ return this.each(function () {
+ var meanMenu = options.meanMenuTarget;
+ var meanContainer = options.meanMenuContainer;
+ var meanMenuClose = options.meanMenuClose;
+ var meanMenuCloseSize = options.meanMenuCloseSize;
+ var meanMenuOpen = options.meanMenuOpen;
+ var meanRevealPosition = options.meanRevealPosition;
+ var meanRevealPositionDistance = options.meanRevealPositionDistance;
+ var meanRevealColour = options.meanRevealColour;
+ var meanScreenWidth = options.meanScreenWidth;
+ var meanNavPush = options.meanNavPush;
+ var meanRevealClass = ".meanmenu-reveal";
+ var meanShowChildren = options.meanShowChildren;
+ var meanExpandableChildren = options.meanExpandableChildren;
+ var meanExpand = options.meanExpand;
+ var meanContract = options.meanContract;
+ var meanRemoveAttrs = options.meanRemoveAttrs;
+ var onePage = options.onePage;
+ var meanDisplay = options.meanDisplay;
+ var removeElements = options.removeElements;
+
+ //detect known mobile/tablet usage
+ var isMobile = false;
+ if ( (navigator.userAgent.match(/iPhone/i)) || (navigator.userAgent.match(/iPod/i)) || (navigator.userAgent.match(/iPad/i)) || (navigator.userAgent.match(/Android/i)) || (navigator.userAgent.match(/Blackberry/i)) || (navigator.userAgent.match(/Windows Phone/i)) ) {
+ isMobile = true;
+ }
+
+ if ( (navigator.userAgent.match(/MSIE 8/i)) || (navigator.userAgent.match(/MSIE 7/i)) ) {
+ // add scrollbar for IE7 & 8 to stop breaking resize function on small content sites
+ jQuery('html').css("overflow-y" , "scroll");
+ }
+
+ var meanRevealPos = "";
+ var meanCentered = function() {
+ if (meanRevealPosition === "center") {
+ var newWidth = window.innerWidth || document.documentElement.clientWidth;
+ var meanCenter = ( (newWidth/2)-22 )+"px";
+ meanRevealPos = "left:" + meanCenter + ";right:auto;";
+
+ if (!isMobile) {
+ jQuery('.meanmenu-reveal').css("left",meanCenter);
+ } else {
+ jQuery('.meanmenu-reveal').animate({
+ left: meanCenter
+ });
+ }
+ }
+ };
+
+ var menuOn = false;
+ var meanMenuExist = false;
+
+
+ if (meanRevealPosition === "right") {
+ meanRevealPos = "right:" + meanRevealPositionDistance + ";left:auto;";
+ }
+ if (meanRevealPosition === "left") {
+ meanRevealPos = "left:" + meanRevealPositionDistance + ";right:auto;";
+ }
+ // run center function
+ meanCentered();
+
+ // set all styles for mean-reveal
+ var $navreveal = "";
+
+ var meanInner = function() {
+ // get last class name
+ if (jQuery($navreveal).is(".meanmenu-reveal.meanclose")) {
+ $navreveal.html(meanMenuClose);
+ } else {
+ $navreveal.html(meanMenuOpen);
+ }
+ };
+
+ // re-instate original nav (and call this on window.width functions)
+ var meanOriginal = function() {
+ jQuery('.mean-bar,.mean-push').remove();
+ jQuery(meanContainer).removeClass("mean-container");
+ jQuery(meanMenu).css('display', meanDisplay);
+ menuOn = false;
+ meanMenuExist = false;
+ jQuery(removeElements).removeClass('mean-remove');
+ };
+
+ // navigation reveal
+ var showMeanMenu = function() {
+ var meanStyles = "background:"+meanRevealColour+";color:"+meanRevealColour+";"+meanRevealPos;
+ if (currentWidth <= meanScreenWidth) {
+ jQuery(removeElements).addClass('mean-remove');
+ meanMenuExist = true;
+ // add class to body so we don't need to worry about media queries here, all CSS is wrapped in '.mean-container'
+ jQuery(meanContainer).addClass("mean-container");
+ jQuery('.mean-container').prepend('<div class="mean-bar"><a href="#nav" class="meanmenu-reveal" style="'+meanStyles+'">Show Navigation</a><nav class="mean-nav"></nav></div>');
+
+ //push meanMenu navigation into .mean-nav
+ var meanMenuContents = jQuery(meanMenu).html();
+ jQuery('.mean-nav').html(meanMenuContents);
+
+ // remove all classes from EVERYTHING inside meanmenu nav
+ if(meanRemoveAttrs) {
+ jQuery('nav.mean-nav ul, nav.mean-nav ul *').each(function() {
+ // First check if this has mean-remove class
+ if (jQuery(this).is('.mean-remove')) {
+ jQuery(this).attr('class', 'mean-remove');
+ } else {
+ jQuery(this).removeAttr("class");
+ }
+ jQuery(this).removeAttr("id");
+ });
+ }
+
+ // push in a holder div (this can be used if removal of nav is causing layout issues)
+ jQuery(meanMenu).before('<div class="mean-push" />');
+ jQuery('.mean-push').css("margin-top",meanNavPush);
+
+ // hide current navigation and reveal mean nav link
+ jQuery(meanMenu).hide();
+ jQuery(".meanmenu-reveal").show();
+
+ // turn 'X' on or off
+ jQuery(meanRevealClass).html(meanMenuOpen);
+ $navreveal = jQuery(meanRevealClass);
+
+ //hide mean-nav ul
+ jQuery('.mean-nav ul').hide();
+
+ // hide sub nav
+ if(meanShowChildren) {
+ // allow expandable sub nav(s)
+ if(meanExpandableChildren){
+ jQuery('.mean-nav ul ul').each(function() {
+ if(jQuery(this).children().length){
+ jQuery(this,'li:first').parent().append('<a class="mean-expand" href="#" style="font-size: '+ meanMenuCloseSize +'">'+ meanExpand +'</a>');
+ }
+ });
+ jQuery('.mean-expand').on("click",function(e){
+ e.preventDefault();
+ if (jQuery(this).hasClass("mean-clicked")) {
+ jQuery(this).text(meanExpand);
+ jQuery(this).prev('ul').slideUp(300, function(){});
+ } else {
+ jQuery(this).text(meanContract);
+ jQuery(this).prev('ul').slideDown(300, function(){});
+ }
+ jQuery(this).toggleClass("mean-clicked");
+ });
+ } else {
+ jQuery('.mean-nav ul ul').show();
+ }
+ } else {
+ jQuery('.mean-nav ul ul').hide();
+ }
+
+ // add last class to tidy up borders
+ jQuery('.mean-nav ul li').last().addClass('mean-last');
+ $navreveal.removeClass("meanclose");
+ jQuery($navreveal).click(function(e){
+ e.preventDefault();
+ if( menuOn === false ) {
+ $navreveal.css("text-align", "center");
+ $navreveal.css("text-indent", "0");
+ $navreveal.css("font-size", meanMenuCloseSize);
+ jQuery('.mean-nav ul:first').slideDown();
+ menuOn = true;
+ } else {
+ jQuery('.mean-nav ul:first').slideUp();
+ menuOn = false;
+ }
+ $navreveal.toggleClass("meanclose");
+ meanInner();
+ jQuery(removeElements).addClass('mean-remove');
+ });
+
+ // for one page websites, reset all variables...
+ if ( onePage ) {
+ jQuery('.mean-nav ul > li > a:first-child').on( "click" , function () {
+ jQuery('.mean-nav ul:first').slideUp();
+ menuOn = false;
+ jQuery($navreveal).toggleClass("meanclose").html(meanMenuOpen);
+ });
+ }
+ } else {
+ meanOriginal();
+ }
+ };
+
+ if (!isMobile) {
+ // reset menu on resize above meanScreenWidth
+ jQuery(window).resize(function () {
+ currentWidth = window.innerWidth || document.documentElement.clientWidth;
+ if (currentWidth > meanScreenWidth) {
+ meanOriginal();
+ } else {
+ meanOriginal();
+ }
+ if (currentWidth <= meanScreenWidth) {
+ showMeanMenu();
+ meanCentered();
+ } else {
+ meanOriginal();
+ }
+ });
+ }
+
+ jQuery(window).resize(function () {
+ // get browser width
+ currentWidth = window.innerWidth || document.documentElement.clientWidth;
+
+ if (!isMobile) {
+ meanOriginal();
+ if (currentWidth <= meanScreenWidth) {
+ showMeanMenu();
+ meanCentered();
+ }
+ } else {
+ meanCentered();
+ if (currentWidth <= meanScreenWidth) {
+ if (meanMenuExist === false) {
+ showMeanMenu();
+ }
+ } else {
+ meanOriginal();
+ }
+ }
+ });
+
+ // run main menuMenu function on load
+ showMeanMenu();
+ });
+ };
+})(jQuery);
diff --git a/wp-content/themes/oni/library/js/libs/modernizr.custom.min.js b/wp-content/themes/oni/library/js/libs/modernizr.custom.min.js
new file mode 100644
index 0000000..89bb6c1
--- /dev/null
+++ b/wp-content/themes/oni/library/js/libs/modernizr.custom.min.js
@@ -0,0 +1,4 @@
+/* Modernizr 2.6.2 (Custom Build) | MIT & BSD
+ * Build: http://modernizr.com/download/#-fontface-backgroundsize-borderimage-flexbox-hsla-multiplebgs-opacity-rgba-textshadow-cssanimations-csscolumns-generatedcontent-cssgradients-cssreflections-csstransforms-csstransforms3d-csstransitions-applicationcache-hashchange-history-audio-video-input-inputtypes-localstorage-websockets-geolocation-svg-svgclippaths-touch-webgl-shiv-mq-cssclasses-addtest-prefixed-teststyles-testprop-testallprops-hasevent-prefixes-domprefixes-css_mediaqueries-css_ [...]
+ */
+;window.Modernizr=function(a,b,c){function D(a){j.cssText=a}function E(a,b){return D(n.join(a+";")+(b||""))}function F(a,b){return typeof a===b}function G(a,b){return!!~(""+a).indexOf(b)}function H(a,b){for(var d in a){var e=a[d];if(!G(e,"-")&&j[e]!==c)return b=="pfx"?e:!0}return!1}function I(a,b,d){for(var e in a){var f=b[a[e]];if(f!==c)return d===!1?a[e]:F(f,"function")?f.bind(d||b):f}return!1}function J(a,b,c){var d=a.charAt(0).toUpperCase()+a.slice(1),e=(a+" "+p.join(d+" ")+d).split( [...]
\ No newline at end of file
diff --git a/wp-content/themes/oni/library/js/scripts.js b/wp-content/themes/oni/library/js/scripts.js
new file mode 100644
index 0000000..02dfd67
--- /dev/null
+++ b/wp-content/themes/oni/library/js/scripts.js
@@ -0,0 +1,120 @@
+/*
+ * Bones Scripts File
+ * Author: Eddie Machado
+ *
+ * This file should contain any js scripts you want to add to the site.
+ * Instead of calling it in the header or throwing it inside wp_head()
+ * this file will be called automatically in the footer so as not to
+ * slow the page load.
+ *
+ * There are a lot of example functions and tools in here. If you don't
+ * need any of it, just remove it. They are meant to be helpers and are
+ * not required. It's your world baby, you can do whatever you want.
+*/
+
+
+/*
+ * Get Viewport Dimensions
+ * returns object with viewport dimensions to match css in width and height properties
+ * ( source: http://andylangton.co.uk/blog/development/get-viewport-size-width-and-height-javascript )
+*/
+function updateViewportDimensions() {
+ var w=window,d=document,e=d.documentElement,g=d.getElementsByTagName('body')[0],x=w.innerWidth||e.clientWidth||g.clientWidth,y=w.innerHeight||e.clientHeight||g.clientHeight;
+ return { width:x,height:y };
+}
+// setting the viewport width
+var viewport = updateViewportDimensions();
+
+
+/*
+ * Throttle Resize-triggered Events
+ * Wrap your actions in this function to throttle the frequency of firing them off, for better performance, esp. on mobile.
+ * ( source: http://stackoverflow.com/questions/2854407/javascript-jquery-window-resize-how-to-fire-after-the-resize-is-completed )
+*/
+var waitForFinalEvent = (function () {
+ var timers = {};
+ return function (callback, ms, uniqueId) {
+ if (!uniqueId) { uniqueId = "Don't call this twice without a uniqueId"; }
+ if (timers[uniqueId]) { clearTimeout (timers[uniqueId]); }
+ timers[uniqueId] = setTimeout(callback, ms);
+ };
+})();
+
+// how long to wait before deciding the resize has stopped, in ms. Around 50-100 should work ok.
+var timeToWaitForLast = 100;
+
+
+/*
+ * Here's an example so you can see how we're using the above function
+ *
+ * This is commented out so it won't work, but you can copy it and
+ * remove the comments.
+ *
+ *
+ *
+ * If we want to only do it on a certain page, we can setup checks so we do it
+ * as efficient as possible.
+ *
+ * if( typeof is_home === "undefined" ) var is_home = $('body').hasClass('home');
+ *
+ * This once checks to see if you're on the home page based on the body class
+ * We can then use that check to perform actions on the home page only
+ *
+ * When the window is resized, we perform this function
+ * $(window).resize(function () {
+ *
+ * // if we're on the home page, we wait the set amount (in function above) then fire the function
+ * if( is_home ) { waitForFinalEvent( function() {
+ *
+ * // update the viewport, in case the window size has changed
+ * viewport = updateViewportDimensions();
+ *
+ * // if we're above or equal to 768 fire this off
+ * if( viewport.width >= 768 ) {
+ * console.log('On home page and window sized to 768 width or more.');
+ * } else {
+ * // otherwise, let's do this instead
+ * console.log('Not on home page, or window sized to less than 768.');
+ * }
+ *
+ * }, timeToWaitForLast, "your-function-identifier-string"); }
+ * });
+ *
+ * Pretty cool huh? You can create functions like this to conditionally load
+ * content and other stuff dependent on the viewport.
+ * Remember that mobile devices and javascript aren't the best of friends.
+ * Keep it light and always make sure the larger viewports are doing the heavy lifting.
+ *
+*/
+
+/*
+ * We're going to swap out the gravatars.
+ * In the functions.php file, you can see we're not loading the gravatar
+ * images on mobile to save bandwidth. Once we hit an acceptable viewport
+ * then we can swap out those images since they are located in a data attribute.
+*/
+function loadGravatars() {
+ // set the viewport using the function above
+ viewport = updateViewportDimensions();
+ // if the viewport is tablet or larger, we load in the gravatars
+ if (viewport.width >= 768) {
+ jQuery('.comment img[data-gravatar]').each(function(){
+ jQuery(this).attr('src',jQuery(this).attr('data-gravatar'));
+ });
+ }
+} // end function
+
+
+/*
+ * Put all your regular jQuery in here.
+*/
+jQuery(document).ready(function($) {
+ jQuery('header nav').meanmenu();
+ /*
+ * Let's fire off the gravatar function
+ * You can remove this if you don't need it
+ */
+ loadGravatars();
+
+
+}); /* end of as page load scripts */
diff --git a/wp-content/uploads/2016/03/FloCon2015-300x225.png b/wp-content/uploads/2016/03/FloCon2015-300x225.png
new file mode 100644
index 0000000..5548349
Binary files /dev/null and b/wp-content/uploads/2016/03/FloCon2015-300x225.png differ
diff --git a/wp-content/uploads/2016/03/FloCon2015-768x576.png b/wp-content/uploads/2016/03/FloCon2015-768x576.png
new file mode 100644
index 0000000..d7b9253
Binary files /dev/null and b/wp-content/uploads/2016/03/FloCon2015-768x576.png differ
diff --git a/wp-content/uploads/2016/03/FloCon2015.png b/wp-content/uploads/2016/03/FloCon2015.png
new file mode 100644
index 0000000..5ce929d
Binary files /dev/null and b/wp-content/uploads/2016/03/FloCon2015.png differ
diff --git a/wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png b/wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png
new file mode 100644
index 0000000..4b7e3ae
Binary files /dev/null and b/wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png differ
diff --git a/wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png b/wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png
new file mode 100644
index 0000000..1d2a955
Binary files /dev/null and b/wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png differ
diff --git a/wp-content/uploads/2016/03/advantages-1-300x136.png b/wp-content/uploads/2016/03/advantages-1-300x136.png
new file mode 100644
index 0000000..688810c
Binary files /dev/null and b/wp-content/uploads/2016/03/advantages-1-300x136.png differ
diff --git a/wp-content/uploads/2016/03/advantages-1-768x347.png b/wp-content/uploads/2016/03/advantages-1-768x347.png
new file mode 100644
index 0000000..8bb9ac1
Binary files /dev/null and b/wp-content/uploads/2016/03/advantages-1-768x347.png differ
diff --git a/wp-content/uploads/2016/03/advantages-1.png b/wp-content/uploads/2016/03/advantages-1.png
new file mode 100644
index 0000000..2487375
Binary files /dev/null and b/wp-content/uploads/2016/03/advantages-1.png differ
diff --git a/wp-content/uploads/2016/03/connects.png b/wp-content/uploads/2016/03/connects.png
new file mode 100644
index 0000000..b74b519
Binary files /dev/null and b/wp-content/uploads/2016/03/connects.png differ
diff --git a/wp-content/uploads/2016/03/how-it-works.png b/wp-content/uploads/2016/03/how-it-works.png
new file mode 100644
index 0000000..14c5ced
Binary files /dev/null and b/wp-content/uploads/2016/03/how-it-works.png differ
diff --git a/wp-content/uploads/2016/03/magnify-icon.png b/wp-content/uploads/2016/03/magnify-icon.png
new file mode 100644
index 0000000..26c87b9
Binary files /dev/null and b/wp-content/uploads/2016/03/magnify-icon.png differ
diff --git a/wp-content/uploads/2016/03/spot470.png b/wp-content/uploads/2016/03/spot470.png
new file mode 100644
index 0000000..ee85398
Binary files /dev/null and b/wp-content/uploads/2016/03/spot470.png differ
diff --git a/wp-content/uploads/2016/03/storyboard-icon.png b/wp-content/uploads/2016/03/storyboard-icon.png
new file mode 100644
index 0000000..5b7299b
Binary files /dev/null and b/wp-content/uploads/2016/03/storyboard-icon.png differ
diff --git a/wp-content/uploads/2016/03/threat-icon.png b/wp-content/uploads/2016/03/threat-icon.png
new file mode 100644
index 0000000..60656d3
Binary files /dev/null and b/wp-content/uploads/2016/03/threat-icon.png differ
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-1024x532.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-1024x532.png
new file mode 100644
index 0000000..89b99fd
Binary files /dev/null and b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-1024x532.png differ
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png
new file mode 100644
index 0000000..07a51de
Binary files /dev/null and b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png differ
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-768x399.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-768x399.png
new file mode 100644
index 0000000..41de6a4
Binary files /dev/null and b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-768x399.png differ
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png
new file mode 100644
index 0000000..edb900a
Binary files /dev/null and b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png differ
diff --git a/wp-includes/js/comment-reply.min.js b/wp-includes/js/comment-reply.min.js
new file mode 100644
index 0000000..4042143
--- /dev/null
+++ b/wp-includes/js/comment-reply.min.js
@@ -0,0 +1 @@
+var addComment={moveForm:function(a,b,c,d){var e,f,g,h,i=this,j=i.I(a),k=i.I(c),l=i.I("cancel-comment-reply-link"),m=i.I("comment_parent"),n=i.I("comment_post_ID"),o=k.getElementsByTagName("form")[0];if(j&&k&&l&&m&&o){i.respondId=c,d=d||!1,i.I("wp-temp-form-div")||(e=document.createElement("div"),e.id="wp-temp-form-div",e.style.display="none",k.parentNode.insertBefore(e,k)),j.parentNode.insertBefore(k,j.nextSibling),n&&d&&(n.value=d),m.value=b,l.style.display="",l.onclick=function(){var [...]
\ No newline at end of file
diff --git a/wp-includes/js/jquery/jquery-migrate.min.js b/wp-includes/js/jquery/jquery-migrate.min.js
new file mode 100644
index 0000000..2e84fcb
--- /dev/null
+++ b/wp-includes/js/jquery/jquery-migrate.min.js
@@ -0,0 +1,2 @@
+/*! jQuery Migrate v1.4.1 | (c) jQuery Foundation and other contributors | jquery.org/license */
+"undefined"==typeof jQuery.migrateMute&&(jQuery.migrateMute=!0),function(a,b,c){function d(c){var d=b.console;f[c]||(f[c]=!0,a.migrateWarnings.push(c),d&&d.warn&&!a.migrateMute&&(d.warn("JQMIGRATE: "+c),a.migrateTrace&&d.trace&&d.trace()))}function e(b,c,e,f){if(Object.defineProperty)try{return void Object.defineProperty(b,c,{configurable:!0,enumerable:!0,get:function(){return d(f),e},set:function(a){d(f),e=a}})}catch(g){}a._definePropertyBroken=!0,b[c]=e}a.migrateVersion="1.4.1";var f={ [...]
\ No newline at end of file
diff --git a/wp-includes/js/jquery/jquery.js b/wp-includes/js/jquery/jquery.js
new file mode 100644
index 0000000..292c720
--- /dev/null
+++ b/wp-includes/js/jquery/jquery.js
@@ -0,0 +1,6 @@
+/*! jQuery v1.12.4 | (c) jQuery Foundation | jquery.org/license */
+!function(a,b){"object"==typeof module&&"object"==typeof module.exports?module.exports=a.document?b(a,!0):function(a){if(!a.document)throw new Error("jQuery requires a window with a document");return b(a)}:b(a)}("undefined"!=typeof window?window:this,function(a,b){var c=[],d=a.document,e=c.slice,f=c.concat,g=c.push,h=c.indexOf,i={},j=i.toString,k=i.hasOwnProperty,l={},m="1.12.4",n=function(a,b){return new n.fn.init(a,b)},o=/^[\s\uFEFF\xA0]+|[\s\uFEFF\xA0]+$/g,p=/^-ms-/,q=/-([\da-z])/gi,r [...]
+}return c}function Q(a){var b;for(b in a)if(("data"!==b||!n.isEmptyObject(a[b]))&&"toJSON"!==b)return!1;return!0}function R(a,b,d,e){if(M(a)){var f,g,h=n.expando,i=a.nodeType,j=i?n.cache:a,k=i?a[h]:a[h]&&h;if(k&&j[k]&&(e||j[k].data)||void 0!==d||"string"!=typeof b)return k||(k=i?a[h]=c.pop()||n.guid++:h),j[k]||(j[k]=i?{}:{toJSON:n.noop}),"object"!=typeof b&&"function"!=typeof b||(e?j[k]=n.extend(j[k],b):j[k].data=n.extend(j[k].data,b)),g=j[k],e||(g.data||(g.data={}),g=g.data),void 0!==d& [...]
+marginLeft:0},function(){return a.getBoundingClientRect().left}):0))+"px":void 0}),n.each({margin:"",padding:"",border:"Width"},function(a,b){n.cssHooks[a+b]={expand:function(c){for(var d=0,e={},f="string"==typeof c?c.split(" "):[c];4>d;d++)e[a+V[d]+b]=f[d]||f[d-2]||f[0];return e}},Na.test(a)||(n.cssHooks[a+b].set=db)}),n.fn.extend({css:function(a,b){return Y(this,function(a,b,c){var d,e,f={},g=0;if(n.isArray(b)){for(d=Ra(a),e=b.length;e>g;g++)f[b[g]]=n.css(a,b[g],!1,d);return f}return v [...]
+padding:"inner"+a,content:b,"":"outer"+a},function(c,d){n.fn[d]=function(d,e){var f=arguments.length&&(c||"boolean"!=typeof d),g=c||(d===!0||e===!0?"margin":"border");return Y(this,function(b,c,d){var e;return n.isWindow(b)?b.document.documentElement["client"+a]:9===b.nodeType?(e=b.documentElement,Math.max(b.body["scroll"+a],e["scroll"+a],b.body["offset"+a],e["offset"+a],e["client"+a])):void 0===d?n.css(b,c,g):n.style(b,c,d,g)},b,f?d:void 0,f,null)}})}),n.fn.extend({bind:function(a,b,c){ [...]
+jQuery.noConflict();
diff --git a/wp-includes/js/wp-embed.min.js b/wp-includes/js/wp-embed.min.js
new file mode 100644
index 0000000..0292141
--- /dev/null
+++ b/wp-includes/js/wp-embed.min.js
@@ -0,0 +1 @@
+!function(a,b){"use strict";function c(){if(!e){e=!0;var a,c,d,f,g=-1!==navigator.appVersion.indexOf("MSIE 10"),h=!!navigator.userAgent.match(/Trident.*rv:11\./),i=b.querySelectorAll("iframe.wp-embedded-content");for(c=0;c<i.length;c++)if(d=i[c],!d.getAttribute("data-secret")){if(f=Math.random().toString(36).substr(2,10),d.src+="#?secret="+f,d.setAttribute("data-secret",f),g||h)a=d.cloneNode(!0),a.removeAttribute("security"),d.parentNode.replaceChild(a,d)}else;}}var d=!1,e=!1;if(b.queryS [...]
\ No newline at end of file
diff --git a/wp-json/index.html b/wp-json/index.html
new file mode 100644
index 0000000..108c0fa
--- /dev/null
+++ b/wp-json/index.html
@@ -0,0 +1 @@
+{"name":"Apache Spot","description":"","url":"http:\/\/spot.incubator.apache.org","home":"http:\/\/spot.incubator.apache.org","namespaces":["oembed\/1.0"],"authentication":[],"routes":{"\/":{"namespace":"","methods":["GET"],"endpoints":[{"methods":["GET"],"args":{"context":{"required":false,"default":"view"}}}],"_links":{"self":"http:\/\/spot.incubator.apache.org\/wp-json\/"}},"\/oembed\/1.0":{"namespace":"oembed\/1.0","methods":["GET"],"endpoints":[{"methods":["GET"],"args":{"namespace" [...]
\ No newline at end of file
[incubator-spot] 37/45: Removed Slack Website References
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 669cc001c810a6ad1720581b4103b2073bb35891
Author: Mark Schoeni <ms...@cloudera.com>
AuthorDate: Wed Aug 15 14:24:09 2018 -0500
Removed Slack Website References
Removed slack website references
used python script page=massedit.py to perform changes.
---
2016/03/index.html | 1 -
2016/08/index.html | 1 -
2016/09/index.html | 1 -
2016/10/index.html | 1 -
2017/03/index.html | 1 -
README.md | 126 +++++++
_Tools/page-massedit.py | 78 +++++
blog/apache-spot-3-most-asked-questions/index.html | 1 -
.../index.html | 1 -
.../index.html | 1 -
.../index.html | 1 -
blog/index.html | 1 -
.../jupyter-notebooks-for-data-analysis/index.html | 1 -
.../index.html | 1 -
category/cybersecurity/index.html | 1 -
category/data-science/index.html | 1 -
category/ipython-notebooks/index.html | 1 -
category/security-analytics/index.html | 1 -
category/threat-analysis-tools/index.html | 1 -
category/uncategorized/index.html | 1 -
community/committers/index.html | 1 -
community/contribute/index.html | 1 -
community/index.html | 374 ++++++++++++---------
contribute/index.html | 2 -
doc/index.html | 1 -
download/index.html | 1 -
get-started/architecture/index.html | 1 -
get-started/demo/index.html | 1 -
get-started/environment/index.html | 1 -
get-started/index.html | 1 -
get-started/supporting-apache/index.html | 1 -
index.html | 1 -
project-components/ingestion/index.html | 5 +-
project-components/machine-learning/index.html | 5 +-
project-components/open-data-models/index.html | 3 +-
.../suspicious-connects-analysis/index.html | 3 +-
project-components/visualization/index.html | 1 -
tag/github/index.html | 1 -
tag/open-network-insight/index.html | 1 -
tag/open-source/index.html | 1 -
40 files changed, 420 insertions(+), 208 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 3b720a8..be7d987 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/2016/08/index.html b/2016/08/index.html
index e42da05..300588a 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -88,7 +88,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/2016/09/index.html b/2016/09/index.html
index 19d590b..589fab3 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/2016/10/index.html b/2016/10/index.html
index 61b5a75..599ac2a 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/2017/03/index.html b/2017/03/index.html
index e0a7f48..9d75d2d 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/README.md b/README.md
new file mode 100644
index 0000000..2f608ed
--- /dev/null
+++ b/README.md
@@ -0,0 +1,126 @@
+# **Apache Spot (Incubating)**
+
+Apache Spot is open source software for leveraging insights from flow and packet analysis. It helps enterprises and service providers gain insight on their computing environments through transparency of service delivery and identification of potential security threats or attacks happening among resources operating at cloud scale.
+
+While current threat intelligence tools help, identifying unknown threats and attacks remains a challenge. Apache Spot provides tools to accelerate companies’ ability to expose suspicious connections and previously unseen attacks using flow and packet analysis technologies.
+<br><br>
+
+----
+
+## **Overview**
+
+With the arrival of big data platforms, security organizations can now make data-driven decisions about how they protect their assets. Records of network traffic, captured as network flows, are often stored and analyzed for use in network management. An organization can use this same information to gain insight into what channels corporate information flows through.
+
+By taking into account additional context such as prevalent attacks and key protocols to the organization, the security team can develop a strategy that applies the right amount of per-channel risk mitigation based on the value of the data flowing through it. For an organization, we call this “the port perspective”.
+
+There are two vectors that all organizations should evaluate:
+
+ * A “wide enough, deep enough” protection strategy that involves both edge prevention and sophisticated detection of unusual behavior
+
+ * A deep inspection of key protocols using methods that can scale to the volume of data flowing across that channel
+
+While inspecting specific, unique flows of data that may be important for individual organizations, all organizations can realize significant risk reduction from analysis of network flows and DNS (domain name service) replies.
+
+**Apache Spot** by leveraging strong technology in both Big Data and Scientific Computing disciplines is a solution intended to support this strategy by focusing on “hard security problems” detecting events such as lateral movement, side-channel data escapes, insider issues, or stealthy behavior in general.
+
+
+### **Telemetry**
+* Flows.
+* DNS (pcaps).
+* Proxy.
+
+### **Parallel Ingest Framework**
+* Open source decoders.
+* Load data in Hadoop.
+* Data transformation.
+
+
+### **Machine Learning**
+* Filter billion of events to a few thousands.
+* Unsupervised learning.
+
+### **Operational Analytics**
+* Visualization.
+* Attack heuristics.
+* Noise filter.
+
+## Try the Apache Spot UI with example data:
+
+*Running Demo on Docker*
+
+1. [Install Docker](https://docs.docker.com/engine/installation/) for your platform
+2. Run the container: `docker run -it -p 8889:8889 apachespot/spot-demo`
+3. visit [http://localhost:8889/files/ui/flow/suspicious.html#date=2016-07-08](http://localhost:8889/files/ui/proxy/suspicious.html#date=2016-07-08) in your browser to get started
+
+For the full instructions visit the [spot](https://hub.docker.com/r/apachespot/spot-demo/) on Docker hub
+
+## **Getting Started**
+
+Apache Spot can be installed by following our installation manual. To get started, [check out the installation instructions in the documentation](http://spot.incubator.apache.org/doc/).
+
+## **Documentation (Developer Guide)**
+
+Apache Spot functionality is divided into different modules, go to each module for developer documentation:
+
+* [spot-ingest](spot-ingest/README.md)
+* [spot-ml](spot-ml/README.md)
+* [spot-oa](spot-oa/README.md)
+* [spot-setup](spot-setup/README.md)
+
+## **Community Support**
+
+Our Central repository for our Apache Spot solution is found here. If you find a bug, have question or something to discuss please contact us:
+
+* [Create an Issue](https://issues.apache.org/jira/browse/SPOT-20?jql=project%20%3D%20SPOT).
+* Sign up for the developer mailing list at <de...@spot.incubator.apache.org>.
+
+## **Contributing to Apache Spot**
+
+Help us improve Apache Spot!
+
+Apache Spot is Apache 2.0 licensed and accepts contributions via GitHub pull requests. Please follow the next steps
+and join our community.
+
+### **Contributing to Apache Spot code**
+
+* Fork the repo of the module that you wish to commit to.
+* Create a Branch, we use [topic branches](https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches) for our commits.
+* Push your commit(s) to your repository.
+* Create a pull request to the original repo in Apache Spot organization.
+
+### **Commit Guidelines**
+
+* Bug fixes should be a single commit.
+* Please be clear with the commit messages about what you are fixing or adding to the code base. If you code is addressing an open issue please add the reference to the issue in the comments with: Fix: Issue's URL.
+
+
+### **Merge approval**
+
+Apache Spot maintainers use +1 in a comment on the code review to indicate acceptance,
+at least 3 "+1" from maintainers are required to approve the merge. If you have any question or concern please feel free to add a comment in your pull request or branch and tag any of the maintainers.
+
+
+## **Licensing**
+
+Apache Spot is licensed under the Apache License, Version 2.0. See [LICENSE](LICENSE) for the full license text.
+
+* spot-nfdump [License](https://github.com/Open-Network-Insight/spot-nfdump/blob/master/BSD-license.txt)
+
+## **Maintainers**
+
+<table border="0" cellspacing="0" cellpadding="0">
+ <tr>
+ <td width="125"><a href="https://github.com/EverLoSa"><sub>@EverLoSa</sub><img src="https://avatars.githubusercontent.com/EverLosa" alt="@EverLoSa"></a></td>
+ <td width="125"><a href="https://github.com/ledalima"><sub>@ledalima</sub><img src="https://avatars.githubusercontent.com/ledalima" alt="@ledalima"></a></td>
+ <td width="125"><a href="https://github.com/rabarona "><sub>@rabarona</sub><img src="https://avatars.githubusercontent.com/rabarona " alt="@rabarona"></a></td>
+ <td width="125"><a href="https://github.com/daortizh "><sub>@daortizh</sub><img src="https://avatars.githubusercontent.com/daortizh " alt="@daortizh"></a></td>
+ </tr>
+ <tr>
+ <td width="125"><a href="https://github.com/natedogs911 "><sub>@natedogs911</sub><img src="https://avatars.githubusercontent.com/natedogs911" alt="@natedogs911"></a></td>
+ <td width="125"><a href="https://github.com/NathanSegerlind "><sub>@NathanSegerlind </sub><img src="https://avatars.githubusercontent.com/NathanSegerlind " alt="@NathanSegerlind"></a></td>
+ <td width="125"><a href="https://github.com/moy8011"><sub>@moy8011</sub><img src="https://avatars.githubusercontent.com/moy8011" alt="@moy8011"></a></td>
+ </tr>
+</table>
+
+
+## Thanks
diff --git a/_Tools/page-massedit.py b/_Tools/page-massedit.py
new file mode 100644
index 0000000..c144e05
--- /dev/null
+++ b/_Tools/page-massedit.py
@@ -0,0 +1,78 @@
+import os
+import fnmatch
+import massedit
+import re
+
+
+print('Welcome to the regex page editor')
+print('Use this to make changes across all the Spot pages (mainly menus) fast')
+print('This is a result of laziness; enjoy')
+
+
+def FindFiles(_rootDir, pattern: str):
+ _fileList = []
+
+ for root, dirs, files in os.walk(_rootDir):
+ for file in fnmatch.filter(files, pattern):
+ _fileList.append(root + "\\" + file)
+
+ return _fileList
+
+
+def RegSearch(_searchPattern, files):
+ filteredFiles = []
+
+ for filePath in files:
+ with open(filePath, "r", encoding='utf-8') as file:
+ for line in file:
+ pattern = re.compile(_searchPattern)
+ matches = pattern.findall(line)
+ if len(matches) > 0:
+ print("{} in file {}".format(line, filePath))
+ filteredFiles.append(filePath)
+ break
+
+ print("\n{} files found containing {} \n\n".format(len(filteredFiles), _searchPattern))
+ return filteredFiles
+
+
+def RegDelLines(_searchPattern, files):
+ for filePath in files:
+ baseName = os.path.basename(filePath)
+ newFileName = os.path.dirname(filePath) + "\\" + baseName + ".new"
+
+ with open(filePath, "r", encoding='utf-8') as oldFile:
+ # create swap file
+ with open(newFileName, "w", encoding='utf-8') as newFile:
+ for line in oldFile:
+ pattern = re.compile(_searchPattern)
+ matches = pattern.findall(line)
+ if len(matches) == 0:
+ newFile.write(line)
+ else:
+ print("skip")
+
+ # Swap Files
+ os.rename(filePath, filePath + ".old")
+ os.rename(newFileName, filePath)
+ os.remove(filePath + ".old")
+
+
+rootDir = "c:\\code\\incubator-spot" #input('enter directory:')
+
+files = FindFiles(rootDir, 'index.html')
+
+searchPattern = "slack|SLACK|Slack" #input("Search Pattern:")
+
+files = RegSearch(searchPattern, files)
+
+print("commands(DelLines / ...)")
+cmd = input("How to Proceed?: ")
+
+if cmd.lower() == 'dellines':
+ RegDelLines(searchPattern, files)
+elif cmd == 'regex':
+ print("Not Implemented Yet")
+ #massedit.edit_files(files, ["re.sub()"])
+
+print('Done')
\ No newline at end of file
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index 8fb4960..1e55797 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index d5520d2..b201c62 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index ef3eef5..99e90af 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index d1727b7..77c55d2 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/blog/index.html b/blog/index.html
index 6014c39..cabfb33 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
<li><a href="../community/contribute">How to Contribute</a></li>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index 75ce752..abe2811 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index dad7fc1..5c64896 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 8bd6e01..ecb702b 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 380d966..998182a 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index f86e23b..3b244b6 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index accecb0..7c2cc4d 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 0948e6e..b4498ea 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 2a2e7ca..3c1c42f 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/community/committers/index.html b/community/committers/index.html
index ae1b6d4..bb78f2f 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li class="active"><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index ddb5eda..75c8f92 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li class="active"><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/community/index.html b/community/index.html
index b68c205..33bd9b1 100755
--- a/community/index.html
+++ b/community/index.html
@@ -5,197 +5,243 @@
<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
<!--[if gt IE 8]><!-->
<html lang="en-US" class="no-js">
- <!--<![endif]-->
+<!--<![endif]-->
- <head>
- <meta charset="utf-8">
+<head>
+ <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Community - Apache Spot</title>
+ <title>Community - Apache Spot</title>
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1" />
- <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
- <link rel="icon" href="../favicon.png">
- <!--[if IE]>
+ <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../favicon.png">
+ <!--[if IE]>
<link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
<![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
-
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic'
+ type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
<link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
<![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
- <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
- <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
-
- <script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-87470508-1', 'auto');
- ga('send', 'pageview');
-
- </script>
- </head>
-
- <body class="page">
-
- <div id="container">
- <header class="header">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../library/images/logo.png" alt="Apache Spot" /></a>
- </p>
-
- <nav>
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a href="../get-started">Get Started</a>
- <ul class="sub-menu">
- <li><a href="../get-started">Get Started</a></li>
- <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
- <li><a href="../get-started/environment">Environment</a></li>
- <li><a href="../get-started/architecture">Architecture</a></li>
- <li><a href="../get-started/demo">Demo</a></li>
- </ul>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../download">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
- <a href="../community">Community</a>
- <ul class="sub-menu com-sm">
- <li class="dropmenu-head">Get in Touch</li>
- <li class="active"><a href="../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
- <li class="divider"></li>
- <li><a href="../community/committers">Project Committers</a></li>
- <li><a href="../community/contribute">How to Contribute</a></li>
- <li class="divider"></li>
- <li class="dropmenu-head">Developer Resources</li>
- <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
- <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li class="divider"></li>
- <li class="dropmenu-head">Social Media</li>
- <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
- </ul>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a href="../doc">Documentation</a>
- </li>
- <li class="menu-item menu-item-has-children">
- <a href="#">Project Components</a>
- <ul class="sub-menu">
- <li><a href="../project-components/ingestion">Ingestion</a></li>
- <li><a href="../project-components/machine-learning">Machine Learning</a></li>
- <li><a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
- <li><a href="../project-components/visualization">Visualization</a></li>
- <li class="under-dev">Under Development</li>
- <li><a href="../project-components/open-data-models">Open Data Models</a></li>
- </ul>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
- <a href="../blog">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
+ <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function (i, s, o, g, r, a, m) {
+ i['GoogleAnalyticsObject'] = r; i[r] = i[r] || function () {
+ (i[r].q = i[r].q || []).push(arguments)
+ }, i[r].l = 1 * new Date(); a = s.createElement(o),
+ m = s.getElementsByTagName(o)[0]; a.async = 1; a.src = g; m.parentNode.insertBefore(a, m)
+ })(window, document, 'script', 'https://www.google-analytics.com/analytics.js', 'ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+</head>
+
+<body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow">
+ <img src="../library/images/logo.png" alt="Apache Spot" />
+ </a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li>
+ <a href="../get-started">Get Started</a>
+ </li>
+ <li>
+ <a href="../get-started/supporting-apache">Supporting Apache</a>
+ </li>
+ <li>
+ <a href="../get-started/environment">Environment</a>
+ </li>
+ <li>
+ <a href="../get-started/architecture">Architecture</a>
+ </li>
+ <li>
+ <a href="../get-started/demo">Demo</a>
+ </li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../download">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
+ <a href="../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li class="active">
+ <a href="../community" class="mail">Mailing Lists</a>
+ </li>
+ <li class="divider"></li>
+ <li>
+ <a href="../community/committers">Project Committers</a>
+ </li>
+ <li>
+ <a href="../community/contribute">How to Contribute</a>
+ </li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li>
+ <a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a>
+ </li>
+ <li>
+ <a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a>
+ </li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li>
+ <a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a>
+ </li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li>
+ <a href="../project-components/ingestion">Ingestion</a>
+ </li>
+ <li>
+ <a href="../project-components/machine-learning">Machine Learning</a>
+ </li>
+ <li>
+ <a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a>
+ </li>
+ <li>
+ <a href="../project-components/visualization">Visualization</a>
+ </li>
+ <li class="under-dev">Under Development</li>
+ <li>
+ <a href="../project-components/open-data-models">Open Data Models</a>
+ </li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
- <div id="mobile-nav"></div>
-
- <div id="content">
+ </div>
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1>Apache Spot Mailing Lists and Chat Rooms</h1>
- <p>Get help using Spot or contribute to the project on our mailing lists or our chat room:</p>
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+ <!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1>Apache Spot Mailing Lists and Chat Rooms</h1>
+ <p>Get help using Spot or contribute to the project on our mailing lists or our chat room:</p>
+
+ <strong>Get Help</strong>
+ <ul>
+ <li>
+ <a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a>
+ </li>
+ <li>
+ <a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
+ <li>
+ <a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issuetracker.</li>
+ </ul>
+
+ <strong>Developer Mailing Lists</strong>
+ <ul>
+ <li>
+ <a href="mailto:dev@spot.incubator.apache.org">dev@spot.incubator.apache.org</a> (<a href="mailto:dev-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:dev-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-dev/" target="_blank">archives</a>) - for people who want to contribute code to Spot.</li>
+ <li>
+ <a href="mailto:commits@spot.incubator.apache.org">commits@spot.incubator.apache.org</a> (<a href="mailto:commits-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:commits-subscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/incubator-spot-commits/" target="_blank">archives</a>) - receives an email notification of all code changes to the Spot Git repository.</li>
+ </ul>
+
+ <strong>Community Resources</strong>
+ <ul>
+ <li>
+ <a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a> - where users and committers will find tools and technical information to commit.</li>
+ </ul>
- <strong>Get Help</strong>
- <ul>
- <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
- <li><a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
- <li><a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issue tracker.</li>
+ </div>
- </ul>
+ </div>
- <strong>Developer Mailing Lists</strong>
- <ul>
- <li><a href="mailto:dev@spot.incubator.apache.org">dev@spot.incubator.apache.org</a> (<a href="mailto:dev-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:dev-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-dev/" target="_blank">archives</a>) - for people who want to contribute code to Spot.</li>
+ </div>
- <li><a href="mailto:commits@spot.incubator.apache.org">commits@spot.incubator.apache.org</a> (<a href="mailto:commits-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:commits-subscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/incubator-spot-commits/" target="_blank">archives</a>) - receives an email notification of all code changes to the Spot Git repository.</li>
- </ul>
- <strong>Community Resources</strong>
- <ul>
- <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">GitHub</a> - where users and committers will find tools and technical information to commit.</li>
+ <div id="more-info">
+ <div class="wrap cf">
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Spot Slack channel</a> - where many Spot developers and users hang out to answer questions and chat.</li>
- </ul>
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
- </div>
+ <p style="margin-top:50px;">
+ <img src="../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
- </div>
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator.
+ Incubation is required of all newly accepted projects until a further review indicates that the infrastructure,
+ communications, and decision making process have stabilized in a manner consistent with other successful
+ ASF projects. While incubation status is not necessarily a reflection of the completeness or stability
+ of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+ </p>
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot
+ and its logo are trademarks of the Apache Software Foundation.
+ </p>
</div>
+ </div>
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
- <div id="more-info">
- <div class="wrap cf">
-
- <p>
- <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
- </p>
-
- <p style="margin-top:50px;"><img src="../library/images/apache-incubator.png" alt="Apache Incubator" />
- </p>
+ <div id="inner-footer" class="wrap cf">
- <p class="disclaimer">
- Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
- </p>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
- <p class="disclaimer">
- The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
- </p>
- </div>
</div>
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
+ </footer>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
- <a href="#0" class="cd-top">Top</a>
- <script type='text/javascript' src='../library/js/scripts.js'></script>
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../library/js/scripts.js'></script>
- </body>
+</body>
-</html>
+</html>
\ No newline at end of file
diff --git a/contribute/index.html b/contribute/index.html
index 81f26a2..6bd19d9 100755
--- a/contribute/index.html
+++ b/contribute/index.html
@@ -60,7 +60,6 @@
<div class="social-sidebar">
<a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a>
<a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
- <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
</div>
<header class="header">
@@ -183,7 +182,6 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@apache-spot.io"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/doc/index.html b/doc/index.html
index 4f74cd8..27d1aae 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -70,7 +70,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
<li><a href="../community/contribute">How to Contribute</a></li>
diff --git a/download/index.html b/download/index.html
index d6ba29c..fba1178 100755
--- a/download/index.html
+++ b/download/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
<li><a href="../community/contribute">How to Contribute</a></li>
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
index 7875aeb..3ee0ade 100755
--- a/get-started/architecture/index.html
+++ b/get-started/architecture/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
index 5b32fd0..0431017 100755
--- a/get-started/demo/index.html
+++ b/get-started/demo/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
index e8d929f..6551afe 100755
--- a/get-started/environment/index.html
+++ b/get-started/environment/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/get-started/index.html b/get-started/index.html
index 88c0632..1cb098f 100755
--- a/get-started/index.html
+++ b/get-started/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../community/committers">Project Committers</a></li>
<li><a href="../community/contribute">How to Contribute</a></li>
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
index deb691f..8b83b43 100755
--- a/get-started/supporting-apache/index.html
+++ b/get-started/supporting-apache/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/index.html b/index.html
index f3ac606..bfa14d7 100755
--- a/index.html
+++ b/index.html
@@ -84,7 +84,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="community/committers">Project Committers</a></li>
<li><a href="community/contribute">How to Contribute</a></li>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index ff51117..902ca3b 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
@@ -124,14 +123,14 @@
<div id="mobile-nav"></div>
- <!--
+ <!--
<div id="masthead">
<div class="wrap cf">
<div class="m-all d-1of2 right-center">
<h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
</div>
</div>
- </div>-->
+ </div>-->
<div id="content">
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 7a7fb8e..be20d01 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
@@ -124,14 +123,14 @@
<div id="mobile-nav"></div>
- <!--
+ <!--
<div id="masthead">
<div class="wrap cf">
<div class="m-all d-1of2 right-center">
<h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
</div>
</div>
- </div>-->
+ </div>-->
<div id="content">
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index bd0dd22..55090fb 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
@@ -122,7 +121,7 @@
</header>
- <div id="mobile-nav"></div>
+ <div id="mobile-nav"></div>
<div id="content">
diff --git a/project-components/suspicious-connects-analysis/index.html b/project-components/suspicious-connects-analysis/index.html
index 2bffb75..fe97bd9 100755
--- a/project-components/suspicious-connects-analysis/index.html
+++ b/project-components/suspicious-connects-analysis/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
@@ -124,7 +123,7 @@
<div id="mobile-nav"></div>
- <div id="content">
+ <div id="content">
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index 75c4d0b..be34570 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/tag/github/index.html b/tag/github/index.html
index 9a4eb8f..a13b4b2 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 343352b..3ce2e5d 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 2bd2ed2..532a1a0 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -85,7 +85,6 @@
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
<li><a href="../../community" class="mail">Mailing Lists</a></li>
- <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
<li><a href="../../community/contribute">How to Contribute</a></li>
[incubator-spot] 40/45: Bug Fix: Duplicate Link to Confluence Page.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 743deaa28bf076e05f18749ee7bedda5ebb76505
Author: Mark Schoeni <ma...@gmail.com>
AuthorDate: Mon Dec 3 17:05:53 2018 -0600
Bug Fix: Duplicate Link to Confluence Page.
---
index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/index.html b/index.html
index 3151786..bc34bfe 100755
--- a/index.html
+++ b/index.html
@@ -91,7 +91,7 @@
<li class="dropmenu-head">Developer Resources</li>
<li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
<li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
-<li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li> <li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li>
+ <li><a href="https://cwiki.apache.org/confluence/pages/viewpage.action?spaceKey=SPOT&title=Apache+Spot+%28Incubating%29+Home" target="_blank" class="">Confluence Site</a></li>
<li class="divider"></li>
<li class="dropmenu-head">Social Media</li>
<li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
[incubator-spot] 09/45: Fixing Inconsistent/incorrect use of Apache
trademark on the blog entry
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit c8b988172620524bab7b5d6463b8c3f3e8c18b52
Author: cesar <ce...@apache.org>
AuthorDate: Mon Oct 17 18:33:09 2016 -0500
Fixing Inconsistent/incorrect use of Apache trademark on the blog entry
---
.../index.html | 32 +++++++++++-----------
1 file changed, 16 insertions(+), 16 deletions(-)
diff --git a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 48fcd16..5902ac9 100644
--- a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <title>Apache Spot (Incubating) How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -31,9 +31,9 @@
<link rel='dns-prefetch' href='//fonts.googleapis.com' />
<link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights Comments Feed" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights Comments Feed" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -198,7 +198,7 @@
<header class="article-header entry-header">
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
<p class="byline entry-meta vcard">
@@ -214,27 +214,27 @@
About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
</p>
<p>
- Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
+ Apache Spot (Incubating) can help to solve most of these issues. Following is a description of the Apache Spot (Incubating), which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
</p>
<a href="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, ../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png 300w, ../wp-content/uploads/2016/09/ONI_Ar [...]
- <h3><strong>Apache Spot Core Components</strong></h3>
+ <h3><strong>Apache Spot (Incubating) Core Components</strong></h3>
<p>
- The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
+ The Apache Spot (Incubating) Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
</p>
<p>
- In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
+ In this diagram, the top left shows Apache Spot (Incubating) Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot (Incubating)’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot (Incubating) clu [...]
</p>
<h3><strong>Operational Analytics</strong></h3>
<p>
- As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
+ As part of operational analytics, Apache Spot (Incubating) executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” wit [...]
</p>
<h3><strong>Visualizing Results</strong></h3>
<p>
- The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
+ The Apache Spot (Incubating) GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
</p>
<h3><strong>Customizable Open Source</strong></h3>
<p>
- Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
+ Because Apache Spot (Incubating) is an open-source project, most of the components depicted here can be modified by the end user.
</p>
</section>
<footer class="article-footer">
@@ -253,13 +253,13 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../open-network-insight-3-most-asked-questions/">Apache Spot (Incubating): Three Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -287,7 +287,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2016 Apache Spot (Incubating).
</p>
</div>
[incubator-spot] 04/45: Update home page.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit fa916404c192de4f140f0922f645d623687af5f0
Author: Doug Cutting <cu...@apache.org>
AuthorDate: Tue Sep 27 19:15:42 2016 -0700
Update home page.
---
index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/index.html b/index.html
index f574b4d..31a6a1e 100644
--- a/index.html
+++ b/index.html
@@ -196,7 +196,7 @@
<br>
at a Glance</h2>
<p>
- For organizations with dynamic data centers and networks, Apache Spot is an advanced threat detection solution that uses big data analytics, that perform at cloud scale, to provide actionable insights into operational and security threats. Running on Cloudera Enterprise Data Hub (EDH), Apache Spot can analyze billions of events in order to detect unknown threats, insider threats, and gain a new level of visibility into the network.
+ For organizations with dynamic data centers and networks, Apache Spot is an advanced threat detection solution that uses big data analytics, that perform at cloud scale, to provide actionable insights into operational and security threats. Running on Apache Hadoop, Apache Spot can analyze billions of events in order to detect unknown threats, insider threats, and gain a new level of visibility into the network.
</p>
<p class="btn-margin">
<a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
[incubator-spot] 06/45: First commit, addion Spot Fav icon
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 2acb4f97274053bf822b550703ab35b3dcf5c422
Author: cesar <ce...@apache.org>
AuthorDate: Mon Oct 17 17:25:49 2016 -0500
First commit, addion Spot Fav icon
---
favicon.ico | Bin 0 -> 1150 bytes
1 file changed, 0 insertions(+), 0 deletions(-)
diff --git a/favicon.ico b/favicon.ico
new file mode 100644
index 0000000..b04db3c
Binary files /dev/null and b/favicon.ico differ
[incubator-spot] 14/45: Adding new blog entry,
updates on website layout
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 6e308689a9406d3a68cb945c7b83682224b70ce7
Author: Cesar <ce...@apache.org>
AuthorDate: Fri Oct 21 20:05:28 2016 -0500
Adding new blog entry, updates on website layout
---
2016/03/index.html | 6 ++
2016/08/index.html | 6 ++
2016/09/index.html | 6 ++
{category/ipython-notebooks => 2016/10}/index.html | 40 ++++++---
blog/index.html | 35 +++++++-
category/cybersecurity/index.html | 6 ++
category/data-science/index.html | 6 ++
category/ipython-notebooks/index.html | 6 ++
category/security-analytics/index.html | 6 ++
category/threat-analysis-tools/index.html | 6 ++
category/uncategorized/index.html | 40 ++++++++-
feed/index.html | 20 +++++
.../feed/index.html | 18 ++++
.../index.html | 96 +++++++++++++--------
tag/github/index.html | 6 ++
tag/open-network-insight/index.html | 6 ++
tag/open-source/index.html | 6 ++
.../themes/oni/library/images/add-to-slack.png | Bin 3457 -> 2506 bytes
18 files changed, 256 insertions(+), 59 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index e1ee89e..1476bb7 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -209,6 +209,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -226,6 +229,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../10/'>October 2016</a>
+ </li>
+ <li>
<a href='../09/'>September 2016</a>
</li>
<li>
diff --git a/2016/08/index.html b/2016/08/index.html
index a1eddf4..61e3284 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -237,6 +237,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -254,6 +257,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../10/'>October 2016</a>
+ </li>
+ <li>
<a href='../09/'>September 2016</a>
</li>
<li>
diff --git a/2016/09/index.html b/2016/09/index.html
index 006c8f3..7945acb 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -200,6 +200,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -217,6 +220,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../10/'>October 2016</a>
+ </li>
+ <li>
<a href='../09/'>September 2016</a>
</li>
<li>
diff --git a/category/ipython-notebooks/index.html b/2016/10/index.html
similarity index 81%
copy from category/ipython-notebooks/index.html
copy to 2016/10/index.html
index 2432f5e..4c7dd4d 100755
--- a/category/ipython-notebooks/index.html
+++ b/2016/10/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Ipython Notebooks</title>
+ <title>Apache Spot 2016 October</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -27,11 +27,10 @@
<meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
- <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
+ <link rel="pingback" href="../../xmlrpc.php">
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Ipython Notebooks Category Feed" href="../../category/ipython-notebooks/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
@@ -115,10 +114,9 @@
<script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
-
</head>
- <body class="archive category category-ipython-notebooks category-10" itemscope itemtype="http://schema.org/WebPage">
+ <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -162,16 +160,16 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Category: Ipython Notebooks</h1>
+ <h1 class="page-title">Month: October 2016</h1>
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <h3 class="h2 entry-title"><a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
</time>
</span>
</p>
@@ -181,7 +179,7 @@
<section class="entry-content cf">
<p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../strength-in-numbers-why-consider-open-source-cyberse [...]
</p>
</section>
@@ -196,10 +194,21 @@
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+ <div id="search-2" class="widget widget_search">
+ <form role="search" method="get" id="searchform" class="searchform" action="../../">
+ <div>
+ <input type="search" id="s" name="s" value="" placeholder="Search..." />
+ <!--<button type="submit" id="searchsubmit" >Search</button>-->
+ </div>
+ </form>
+ </div>
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -217,13 +226,16 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
- <a href='../../2016/09/'>September 2016</a>
+ <a href='../10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../09/'>September 2016</a>
</li>
<li>
- <a href='../../2016/08/'>August 2016</a>
+ <a href='../08/'>August 2016</a>
</li>
<li>
- <a href='../../2016/03/'>March 2016</a>
+ <a href='../03/'>March 2016</a>
</li>
</ul>
</div>
diff --git a/blog/index.html b/blog/index.html
index 2a4d356..9ef59c2 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -42,8 +42,7 @@
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
- };
- ! function(a, b, c) {
+ }; ! function(a, b, c) {
function d(a) {
var c,
d,
@@ -126,7 +125,6 @@
<script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../wp-json/' />
-
</head>
<body class="blog" itemscope itemtype="http://schema.org/WebPage">
@@ -172,6 +170,31 @@
<div id="inner-content" class="wrap cf">
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../strength-in-numbers-why-consider-open-source-cybers [...]
+ </p>
+ </div>
+ </section>
+
+ </article>
+
<article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
<header class="article-header">
@@ -280,6 +303,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -297,6 +323,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 7b440f1..9b9813c 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -211,6 +211,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -228,6 +231,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index d416f07..5138c39 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -200,6 +200,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -217,6 +220,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index 2432f5e..eb22952 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -200,6 +200,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -217,6 +220,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index c2eac46..fed54c5 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -210,6 +210,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -227,6 +230,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 0d13dd8..7220abd 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -200,6 +200,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -217,6 +220,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index 48a6ef6..e9962d5 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -43,8 +43,7 @@
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
- };
- ! function(a, b, c) {
+ }; ! function(a, b, c) {
function d(a) {
var c,
d,
@@ -174,7 +173,34 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
<h1 class="page-title">Category: Uncategorized</h1>
-
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../strength-in-numbers-why-consider-open-source-cyberse [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
<article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
@@ -205,13 +231,16 @@
</article>
</main>
-
+
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -229,6 +258,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/feed/index.html b/feed/index.html
index 29f0268..135e075 100755
--- a/feed/index.html
+++ b/feed/index.html
@@ -17,6 +17,26 @@
<sy:updatePeriod>hourly</sy:updatePeriod>
<sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
+ <link>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/</link>
+ <comments>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/#respond</comments>
+ <pubDate>Fri, 21 Oct 2016 15:48:33 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Uncategorized]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=149</guid>
+ <description><![CDATA[By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology.... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/strength-in-numbers-why-consider-o [...]
+ <content:encoded><![CDATA[<p>By Rob Kent, Vice President of Marketing at Cybraics</p>
+ <p>Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on competing and winning customers, [...]
+ <p>This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often looked at as a costly problem to [...]
+ <p>By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve tackled or how they need to ta [...]
+ <p>By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leveling the playing field. </p>
+ ]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
<item>
<title>Jupyter Notebooks for Data Analysis</title>
<link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
diff --git a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/index.html b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/index.html
new file mode 100755
index 0000000..0d495b9
--- /dev/null
+++ b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
+ <atom:link href="http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/2016/09/index.html b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
similarity index 53%
copy from 2016/09/index.html
copy to strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 006c8f3..9a70d55 100755
--- a/2016/09/index.html
+++ b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -12,25 +12,26 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot 2016 September</title>
+ <title>Apache Spot Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
<meta name="viewport" content="width=device-width, initial-scale=1"/>
- <link rel="apple-touch-icon" href="../../../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../../../wp-content/themes/oni/favicon.png">
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
<!--[if IE]>
- <link rel="shortcut icon" href="http://spot.incubator.apache.org/wp-content/themes/oni/favicon.ico">
+ <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
<![endif]-->
<meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
<link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="http://spot.incubator.apache.org/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="http://spot.incubator.apache.org/comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Strength in Numbers: Why Consider Open Source Cybersecurity Analytics Comments Feed" href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
@@ -104,20 +105,24 @@
}
</style>
<link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
<!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
<![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" />
+ <link rel='shortlink' href='http://spot.incubator.apache.org/?p=149' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fstrength-in-numbers-why-consider-open-source-cybersecurity-analytics%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fstrength-in-numbers-why-consider-open-source-cybersecurity-analytics%2F&format=xml" />
</head>
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
+ <body class="single single-post postid-149 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -126,7 +131,7 @@
<div id="inner-header" class="wrap cf">
<p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
</p>
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
@@ -144,7 +149,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
+ <a href="../blog">Blog</a>
</li>
</ul>
</nav>
@@ -161,52 +166,63 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Month: September 2016</h1>
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+ <header class="article-header entry-header">
- <header class="entry-header article-header">
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</h1>
- <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
+
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
</time>
</span>
</p>
</header>
-
- <section class="entry-content cf">
-
+ <section class="entry-content cf" itemprop="articleBody">
<p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more &ra [...]
+ By Rob Kent, Vice President of Marketing at Cybraics
+ </p>
+ <p>
+ Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on com [...]
+ </p>
+ <p>
+ This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often look [...]
+ </p>
+ <p>
+ By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve t [...]
+ </p>
+ <p>
+ By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leve [...]
</p>
-
</section>
-
<footer class="article-footer">
+ filed under: <a href="../category/uncategorized/" rel="category tag">Uncategorized</a>
+
</footer>
</article>
</main>
-
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
<a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="h../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
<a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
@@ -217,13 +233,16 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
- <a href='../09/'>September 2016</a>
+ <a href='../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../2016/09/'>September 2016</a>
</li>
<li>
- <a href='../08/'>August 2016</a>
+ <a href='../2016/08/'>August 2016</a>
</li>
<li>
- <a href='../03/'>March 2016</a>
+ <a href='../2016/03/'>March 2016</a>
</li>
</ul>
</div>
@@ -249,8 +268,9 @@
</div>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
</body>
diff --git a/tag/github/index.html b/tag/github/index.html
index 30bddb1..1392375 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -210,6 +210,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -227,6 +230,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index d776bdf..b648c87 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -210,6 +210,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -227,6 +230,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 313d344..304768c 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -210,6 +210,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -227,6 +230,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/wp-content/themes/oni/library/images/add-to-slack.png b/wp-content/themes/oni/library/images/add-to-slack.png
index 6e1f1d8..9f15e5e 100755
Binary files a/wp-content/themes/oni/library/images/add-to-slack.png and b/wp-content/themes/oni/library/images/add-to-slack.png differ
[incubator-spot] 16/45: Jan 2017 Project website updates and new
documentation section
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 675520b70f532561ab8831321bf29f18da5ee92e
Author: Cesar <ce...@apache.org>
AuthorDate: Tue Jan 17 18:25:02 2017 -0600
Jan 2017 Project website updates and new documentation section
---
2016/03/index.html | 273 ------------------
2016/08/index.html | 301 --------------------
2016/09/index.html | 264 ------------------
2016/10/index.html | 270 ------------------
blog/index.html | 367 -------------------------
category/cybersecurity/feed/index.html | 10 +-
category/cybersecurity/index.html | 275 ------------------
category/data-science/feed/index.html | 10 +-
category/data-science/index.html | 264 ------------------
category/ipython-notebooks/feed/index.html | 10 +-
category/ipython-notebooks/index.html | 264 ------------------
category/security-analytics/feed/index.html | 10 +-
category/security-analytics/index.html | 274 ------------------
category/threat-analysis-tools/feed/index.html | 10 +-
category/threat-analysis-tools/index.html | 264 ------------------
category/uncategorized/feed/index.html | 20 +-
category/uncategorized/index.html | 302 --------------------
favicon.ico | Bin
feed/index.html | 48 ++--
tag/github/feed/index.html | 10 +-
tag/github/index.html | 274 ------------------
tag/open-network-insight/feed/index.html | 10 +-
tag/open-network-insight/index.html | 274 ------------------
tag/open-source/feed/index.html | 10 +-
tag/open-source/index.html | 274 ------------------
25 files changed, 74 insertions(+), 4014 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
deleted file mode 100755
index bcc75f7..0000000
--- a/2016/03/index.html
+++ /dev/null
@@ -1,273 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot 2016 March</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: March 2016</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../10/'>October 2016</a>
- </li>
- <li>
- <a href='../09/'>September 2016</a>
- </li>
- <li>
- <a href='../08/'>August 2016</a>
- </li>
- <li>
- <a href='../03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/2016/08/index.html b/2016/08/index.html
deleted file mode 100755
index 4c7aef7..0000000
--- a/2016/08/index.html
+++ /dev/null
@@ -1,301 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot 2016 August</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: August 2016</h1>
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-det [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-apache-spot-helps-create-well-stocked-dat [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../10/'>October 2016</a>
- </li>
- <li>
- <a href='../09/'>September 2016</a>
- </li>
- <li>
- <a href='../08/'>August 2016</a>
- </li>
- <li>
- <a href='../03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/2016/09/index.html b/2016/09/index.html
deleted file mode 100755
index a57b337..0000000
--- a/2016/09/index.html
+++ /dev/null
@@ -1,264 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot 2016 September</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="http://spot.incubator.apache.org/wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
-
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="http://spot.incubator.apache.org/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="http://spot.incubator.apache.org/comments/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
- "ext" : ".png",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f = b.createElement("canvas"),
- g = f.getContext && f.getContext("2d"),
- h = String.fromCharCode;
- if (!g || !g.fillText)
- return !1;
- switch(g.textBaseline="top",g.font="600 32px Arial",a) {
- case"flag":
- return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
- case"diversity":
- return g.fillText(h(55356, 57221), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
- case"simple":
- return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: September 2016</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more &ra [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../10/'>October 2016</a>
- </li>
- <li>
- <a href='../09/'>September 2016</a>
- </li>
- <li>
- <a href='../08/'>August 2016</a>
- </li>
- <li>
- <a href='../03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/2016/10/index.html b/2016/10/index.html
deleted file mode 100755
index a10c181..0000000
--- a/2016/10/index.html
+++ /dev/null
@@ -1,270 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot 2016 October</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
- "ext" : ".png",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f = b.createElement("canvas"),
- g = f.getContext && f.getContext("2d"),
- h = String.fromCharCode;
- if (!g || !g.fillText)
- return !1;
- switch(g.textBaseline="top",g.font="600 32px Arial",a) {
- case"flag":
- return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
- case"diversity":
- return g.fillText(h(55356, 57221), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
- case"simple":
- return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
- </head>
-
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: October 2016</h1>
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../strength-in-numbers-why-consider-open-source-cyberse [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="search-2" class="widget widget_search">
- <form role="search" method="get" id="searchform" class="searchform" action="../../">
- <div>
- <input type="search" id="s" name="s" value="" placeholder="Search..." />
- <!--<button type="submit" id="searchsubmit" >Search</button>-->
- </div>
- </form>
- </div>
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../10/'>October 2016</a>
- </li>
- <li>
- <a href='../09/'>September 2016</a>
- </li>
- <li>
- <a href='../08/'>August 2016</a>
- </li>
- <li>
- <a href='../03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/blog/index.html b/blog/index.html
deleted file mode 100755
index b7df948..0000000
--- a/blog/index.html
+++ /dev/null
@@ -1,367 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot Blog</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../wp-json/' />
-
- </head>
-
- <body class="blog" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
- <a href="../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../strength-in-numbers-why-consider-open-source-cybers [...]
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more »</a>
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats- [...]
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-apache-spot-helps-create-well-stocked-da [...]
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
- </div>
- </section>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/cybersecurity/feed/index.html b/category/cybersecurity/feed/index.html
index fac6f3a..fd8364a 100755
--- a/category/cybersecurity/feed/index.html
+++ b/category/cybersecurity/feed/index.html
@@ -19,14 +19,14 @@
<item>
<title>Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
- <link>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
- <comments>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <comments>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
<pubDate>Mon, 08 Aug 2016 08:00:32 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Cybersecurity]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=117</guid>
- <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-dete [...]
+ <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to [...]
<content:encoded><![CDATA[<p>The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each att [...]
<p>Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:</p>
<ol>
@@ -41,10 +41,10 @@
<p>Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenarios. With Apache Spot, attacks that [...]
<p>Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.</p>
<p><strong>But Wait, There’s More</strong></p>
-<p>Check out “<a href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
+<p>Check out “<a href="http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
<p>This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
deleted file mode 100755
index 4dfdda1..0000000
--- a/category/cybersecurity/index.html
+++ /dev/null
@@ -1,275 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Cybersecurity</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Cybersecurity Category Feed" href="../../category/cybersecurity/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
-
- </head>
-
- <body class="archive category category-cybersecurity category-9" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Cybersecurity</h1>
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-t [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/data-science/feed/index.html b/category/data-science/feed/index.html
index e2c33f6..15e5cd9 100755
--- a/category/data-science/feed/index.html
+++ b/category/data-science/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Jupyter Notebooks for Data Analysis</title>
- <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
- <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/#respond</comments>
<pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Data Science]]></category>
@@ -28,12 +28,12 @@
<category><![CDATA[Threat Analysis Tools]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
- <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis" [...]
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Anal [...]
<content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
<p>The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – thus the [...]
<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
-<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<img src="http://spot.incubator.apache.org/library/images/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" />
<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
@@ -55,7 +55,7 @@
<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/data-science/index.html b/category/data-science/index.html
deleted file mode 100755
index 879d3ef..0000000
--- a/category/data-science/index.html
+++ /dev/null
@@ -1,264 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot Data Science</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
-
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Data Science Category Feed" href="../../category/data-science/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
- "ext" : ".png",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f = b.createElement("canvas"),
- g = f.getContext && f.getContext("2d"),
- h = String.fromCharCode;
- if (!g || !g.fillText)
- return !1;
- switch(g.textBaseline="top",g.font="600 32px Arial",a) {
- case"flag":
- return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
- case"diversity":
- return g.fillText(h(55356, 57221), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
- case"simple":
- return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive category category-data-science category-11" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Data Science</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/ipython-notebooks/feed/index.html b/category/ipython-notebooks/feed/index.html
index 1935eed..6af5e8e 100755
--- a/category/ipython-notebooks/feed/index.html
+++ b/category/ipython-notebooks/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Jupyter Notebooks for Data Analysis</title>
- <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
- <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/#respond</comments>
<pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Data Science]]></category>
@@ -28,12 +28,12 @@
<category><![CDATA[Threat Analysis Tools]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
- <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis" [...]
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Anal [...]
<content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
<p>The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – thus the [...]
<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
-<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<img src="http://spot.incubator.apache.org/library/images/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" />
<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
@@ -55,7 +55,7 @@
<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
deleted file mode 100755
index e5e1bff..0000000
--- a/category/ipython-notebooks/index.html
+++ /dev/null
@@ -1,264 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot Ipython Notebooks</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
-
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Ipython Notebooks Category Feed" href="../../category/ipython-notebooks/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
- "ext" : ".png",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f = b.createElement("canvas"),
- g = f.getContext && f.getContext("2d"),
- h = String.fromCharCode;
- if (!g || !g.fillText)
- return !1;
- switch(g.textBaseline="top",g.font="600 32px Arial",a) {
- case"flag":
- return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
- case"diversity":
- return g.fillText(h(55356, 57221), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
- case"simple":
- return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive category category-ipython-notebooks category-10" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Ipython Notebooks</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/security-analytics/feed/index.html b/category/security-analytics/feed/index.html
index c3706f5..27c1ee2 100755
--- a/category/security-analytics/feed/index.html
+++ b/category/security-analytics/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Apache Spot: Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,12 +29,12 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Rea [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<a href="http://spot.incubator.apache.org/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a></p>
<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
<p><strong>Why Intel?</strong></p>
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
@@ -44,7 +44,7 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
deleted file mode 100755
index 686c958..0000000
--- a/category/security-analytics/index.html
+++ /dev/null
@@ -1,274 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Security Analytics</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Security Analytics Category Feed" href="../../category/security-analytics/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive category category-security-analytics category-4" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Security Analytics</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/threat-analysis-tools/feed/index.html b/category/threat-analysis-tools/feed/index.html
index 0e0f486..b2a730d 100755
--- a/category/threat-analysis-tools/feed/index.html
+++ b/category/threat-analysis-tools/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Jupyter Notebooks for Data Analysis</title>
- <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
- <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/#respond</comments>
<pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Data Science]]></category>
@@ -28,12 +28,12 @@
<category><![CDATA[Threat Analysis Tools]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
- <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis" [...]
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Anal [...]
<content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
<p>The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – thus the [...]
<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
-<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<img src="http://spot.incubator.apache.org/library/images/iPython-1.png" alt="ipython" class="aligncenter size-full wp-image-140" />
<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
@@ -55,7 +55,7 @@
<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
deleted file mode 100755
index 9db73e5..0000000
--- a/category/threat-analysis-tools/index.html
+++ /dev/null
@@ -1,264 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot Threat Analysis Tools</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
-
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Threat Analysis Tools Category Feed" href="../../category/threat-analysis-tools/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
- "ext" : ".png",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f = b.createElement("canvas"),
- g = f.getContext && f.getContext("2d"),
- h = String.fromCharCode;
- if (!g || !g.fillText)
- return !1;
- switch(g.textBaseline="top",g.font="600 32px Arial",a) {
- case"flag":
- return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
- case"diversity":
- return g.fillText(h(55356, 57221), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
- c = g.getImageData(16, 16, 1, 1).data,
- e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
- case"simple":
- return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive category category-threat-analysis-tools category-9" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Threat Analysis Tools</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/uncategorized/feed/index.html b/category/uncategorized/feed/index.html
index 4d92163..2f7b180 100755
--- a/category/uncategorized/feed/index.html
+++ b/category/uncategorized/feed/index.html
@@ -19,19 +19,19 @@
<item>
<title>Jupyter Notebooks for Data Analysis</title>
- <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
- <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/#respond</comments>
<pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
- <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analy [...]
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data [...]
<content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
<p>The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – th [...]
<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
-<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<img src="http://spot.incubator.apache.org/library/images/iPython-1.png" alt="ipython" class="aligncenter size-full wp-image-140" />
<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
@@ -53,23 +53,23 @@
<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
<title>How Apache (Incubating) Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
- <link>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
- <comments>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <comments>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
<pubDate>Mon, 08 Aug 2016 07:59:41 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=113</guid>
- <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well [...]
+ <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/how-apache-spot-helps-create [...]
<content:encoded><![CDATA[<p>About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what order [...]
<p>Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.</p>
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org/wp-content/uploads/2016/09 [...]
+<a href="http://spot.incubator.apache.org/library/images/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org/library/images/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" class="alignnone size-full wp-image-114" /></a>
<h3><strong>Apache Spot Core Components</strong></h3>
<p>The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.</p>
<p>In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and ensures that resources can grow [...]
@@ -80,7 +80,7 @@
<h3><strong>Customizable Open Source</strong></h3>
<p>Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
deleted file mode 100755
index aaf4fa4..0000000
--- a/category/uncategorized/index.html
+++ /dev/null
@@ -1,302 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot Uncategorized</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Uncategorized Category Feed" href="../../category/uncategorized/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive category category-uncategorized category-1" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Uncategorized</h1>
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../strength-in-numbers-why-consider-open-source-cyberse [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-apache-spot-helps-create-well-stocked-dat [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/favicon.ico b/favicon.ico
old mode 100644
new mode 100755
diff --git a/feed/index.html b/feed/index.html
index 135e075..f25ad94 100755
--- a/feed/index.html
+++ b/feed/index.html
@@ -20,38 +20,38 @@
<item>
<title>Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</title>
- <link>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/</link>
- <comments>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/</link>
+ <comments>http://spot.incubator.apache.org/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/#respond</comments>
<pubDate>Fri, 21 Oct 2016 15:48:33 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=149</guid>
- <description><![CDATA[By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology.... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/strength-in-numbers-why-consider-o [...]
+ <description><![CDATA[By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology.... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/strength-in-numbers-why-consi [...]
<content:encoded><![CDATA[<p>By Rob Kent, Vice President of Marketing at Cybraics</p>
<p>Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on competing and winning customers, [...]
<p>This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often looked at as a costly problem to [...]
<p>By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve tackled or how they need to ta [...]
<p>By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leveling the playing field. </p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
<title>Jupyter Notebooks for Data Analysis</title>
- <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
- <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/#respond</comments>
<pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
- <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analy [...]
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data [...]
<content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
<p>The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – th [...]
<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
-<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<img src="http://spot.incubator.apache.org/library/images/iPython-1.png" alt="ipython" class="aligncenter size-full wp-image-140" />
<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
@@ -73,20 +73,20 @@
<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
<title>Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
- <link>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
- <comments>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <comments>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
<pubDate>Mon, 08 Aug 2016 08:00:32 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Cybersecurity]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=117</guid>
- <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-dete [...]
+ <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to [...]
<content:encoded><![CDATA[<p>The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each att [...]
<p>Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:</p>
<ol>
@@ -101,25 +101,25 @@
<p>Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenarios. With Apache Spot, attacks that [...]
<p>Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.</p>
<p><strong>But Wait, There’s More</strong></p>
-<p>Check out “<a href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
+<p>Check out “<a href="http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
<p>This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
<title>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
- <link>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
- <comments>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <comments>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
<pubDate>Mon, 08 Aug 2016 07:59:41 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=113</guid>
- <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well [...]
+ <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/how-apache-spot-helps-create [...]
<content:encoded><![CDATA[<p>About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what order [...]
<p>Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.</p>
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org/wp-content/uploads/2016/09 [...]
+<a href="http://spot.incubator.apache.org/library/images/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org/library/images/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" class="alignnone size-full wp-image-114" /></a>
<h3><strong>Apache Spot Core Components</strong></h3>
<p>The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.</p>
<p>In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and ensures that resources can grow [...]
@@ -130,13 +130,13 @@
<h3><strong>Customizable Open Source</strong></h3>
<p>Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
<title>Apache Spot (Incubating): Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -145,12 +145,12 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Rea [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<a href="http://spot.incubator.apache.org/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a></p>
<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
<p><strong>Why Intel?</strong></p>
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
@@ -160,7 +160,7 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/tag/github/feed/index.html b/tag/github/feed/index.html
index 71bcefa..e4a9a46 100755
--- a/tag/github/feed/index.html
+++ b/tag/github/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Apache Spot (Incubating): Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,12 +29,12 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Rea [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<a href="http://spot.incubator.apache.org/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a></p>
<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
<p><strong>Why Intel?</strong></p>
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
@@ -44,7 +44,7 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/tag/github/index.html b/tag/github/index.html
deleted file mode 100755
index 80783c0..0000000
--- a/tag/github/index.html
+++ /dev/null
@@ -1,274 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Github</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » github Tag Feed" href="../../tag/github/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive tag tag-github tag-6" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Tag: github</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/tag/open-network-insight/feed/index.html b/tag/open-network-insight/feed/index.html
index b30ebf2..4787a59 100755
--- a/tag/open-network-insight/feed/index.html
+++ b/tag/open-network-insight/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Apache Spot (Incubating): Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,12 +29,12 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Rea [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<a href="http://spot.incubator.apache.org/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a></p>
<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
<p><strong>Why Intel?</strong></p>
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
@@ -44,7 +44,7 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
deleted file mode 100755
index e694d09..0000000
--- a/tag/open-network-insight/index.html
+++ /dev/null
@@ -1,274 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Open Network Insight</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » open network insight Tag Feed" href="../../tag/apache-spot/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive tag tag-apache-spot tag-7" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Tag: open network insight</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/tag/open-source/feed/index.html b/tag/open-source/feed/index.html
index 42cd1c0..5e237bb 100755
--- a/tag/open-source/feed/index.html
+++ b/tag/open-source/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Apache Spot (Incubating): Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <link>http://spot.incubator.apache.org/blog/open-network-insight-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/blog/open-network-insight-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,12 +29,12 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/blog/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Quest [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
-<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
+<a href="http://spot.incubator.apache.org/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a></p>
<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
<p><strong>Why Intel?</strong></p>
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
@@ -44,7 +44,7 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/blog/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
deleted file mode 100755
index 64e0e47..0000000
--- a/tag/open-source/index.html
+++ /dev/null
@@ -1,274 +0,0 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot open source</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="../../xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » open source Tag Feed" href="../../tag/open-source/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- }; ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='../../wp-json/' />
-
- </head>
-
- <body class="archive tag tag-open-source tag-5" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
- <a href="../../blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Tag: open source</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
-
- <div id="recent-posts-2" class="widget widget_recent_entries">
- <h4 class="widgettitle">Recent Posts</h4>
- <ul>
- <li>
- <a href="../../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
- </li>
- <li>
- <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
- </li>
- <li>
- <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
- </li>
- <li>
- <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
- </li>
- <li>
- <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
- </li>
- </ul>
- </div>
- <div id="archives-2" class="widget widget_archive">
- <h4 class="widgettitle">Archives</h4>
- <ul>
- <li>
- <a href='../../2016/10/'>October 2016</a>
- </li>
- <li>
- <a href='../../2016/09/'>September 2016</a>
- </li>
- <li>
- <a href='../../2016/08/'>August 2016</a>
- </li>
- <li>
- <a href='../../2016/03/'>March 2016</a>
- </li>
- </ul>
- </div>
-
- </div>
-
- </div>
-
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='../../wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='../../wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
[incubator-spot] 23/45: Corporate commiters banner update
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit ed93752c4b62629dec20ebc2eb10fd994fed7aa5
Author: Cesar <ce...@apache.org>
AuthorDate: Thu Feb 23 22:12:51 2017 -0600
Corporate commiters banner update
---
2016/.DS_Store | Bin 6148 -> 0 bytes
index.html | 6 +++---
library/images/community/streamsets.png | Bin 0 -> 8598 bytes
3 files changed, 3 insertions(+), 3 deletions(-)
diff --git a/2016/.DS_Store b/2016/.DS_Store
deleted file mode 100644
index e8e8149..0000000
Binary files a/2016/.DS_Store and /dev/null differ
diff --git a/index.html b/index.html
index 815d1c9..47b5a32 100755
--- a/index.html
+++ b/index.html
@@ -305,9 +305,9 @@
<img src="library/images/community/cybraics.png" alt="Cybraics" />
<img src="library/images/community/centrify.png" alt="Centrify" />
<img src="library/images/community/ebay.png" alt="Ebay" />
- <img src="library/images/community/semantix.png" alt="Ebay" />
- <img src="library/images/community/rich-it.png" alt="Ebay" />
-
+ <img src="library/images/community/semantix.png" alt="Semantix" />
+ <img src="library/images/community/rich-it.png" alt="Rich-It" />
+ <img src="library/images/community/streamsets.png" alt="StreamSets" />
</div>
</div>
diff --git a/library/images/community/streamsets.png b/library/images/community/streamsets.png
new file mode 100755
index 0000000..f9d01b9
Binary files /dev/null and b/library/images/community/streamsets.png differ
[incubator-spot] 44/45: fixed user mailing list address
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 0081dcc1ff5af3225643a8b759461231b9376244
Author: Mark Schoeni <ma...@gmail.com>
AuthorDate: Fri Mar 29 22:17:52 2019 -0500
fixed user mailing list address
---
community/index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/community/index.html b/community/index.html
index 930093a..9cafbc8 100755
--- a/community/index.html
+++ b/community/index.html
@@ -171,7 +171,7 @@
<a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a>
</li>
<li>
- <a href="mailto:user@spot.apache.org">user@spot.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
+ <a href="mailto:user@spot.incubator.apache.org">user@spot.incubator.apache.org</a> (<a href="mailto:user-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:user-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-user/" target="_blank">archives</a>) - for usage questions, help, and announcements.</li>
<li>
<a href="mailto:issues@spot.incubator.apache.org">issues@spot.incubator.apache.org</a> (<a href="mailto:issues-subscribe@spot.incubator.apache.org">subscribe</a>) (<a href="mailto:issues-unsubscribe@spot.incubator.apache.org">unsubscribe</a>) (<a href="http://mail-archives.apache.org/mod_mbox/spot-issues/" target="_blank">archives</a>) - receives an email notification for all ticket updates made in the Spot JIRA issuetracker.</li>
</ul>
[incubator-spot] 05/45: Updating website
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 263c2647c6cb9ee93e355038382db9cc4bafbf1c
Author: Mark Grover <ma...@apache.org>
AuthorDate: Wed Oct 12 09:55:42 2016 -0700
Updating website
---
2016/03/index.html | 38 +--
2016/08/index.html | 40 +--
2016/{03 => 09}/index.html | 111 +++----
apache-spot-3-most-asked-questions/feed/index.html | 18 ++
.../index.html | 150 +++++-----
.../feed/index.html | 18 ++
.../index.html | 153 +++++-----
blog/index.html | 79 +++--
category/cybersecurity/feed/index.html | 10 +-
category/cybersecurity/index.html | 35 +--
category/data-science/feed/index.html | 62 ++++
{2016/03 => category/data-science}/index.html | 97 +++---
category/ipython-notebooks/feed/index.html | 62 ++++
{2016/03 => category/ipython-notebooks}/index.html | 95 +++---
category/security-analytics/feed/index.html | 10 +-
category/security-analytics/index.html | 46 ++-
category/threat-analysis-tools/feed/index.html | 62 ++++
.../threat-analysis-tools}/index.html | 97 +++---
category/uncategorized/feed/index.html | 56 +++-
category/uncategorized/index.html | 45 ++-
feed/index.html | 84 ++++--
.../feed/index.html | 18 ++
.../index.html | 135 ++++-----
index.html | 99 +-----
.../feed/index.html | 18 ++
jupyter-notebooks-for-data-analysis/index.html | 333 +++++++++++++++++++++
tag/github/feed/index.html | 12 +-
tag/github/index.html | 46 ++-
tag/open-network-insight/feed/index.html | 16 +-
tag/open-network-insight/index.html | 50 ++--
tag/open-source/feed/index.html | 2 +-
tag/open-source/index.html | 44 +--
wp-content/themes/oni/favicon.ico | Bin 0 -> 1150 bytes
wp-content/themes/oni/favicon.png | Bin 564 -> 2787 bytes
wp-content/themes/oni/library/css/style.css | 2 +
.../themes/oni/library/images/add-to-slack.png | Bin 0 -> 3789 bytes
.../themes/oni/library/images/apple-touch-icon.png | Bin 5971 -> 11173 bytes
.../themes/oni/library/images/win8-tile-icon.png | Bin 0 -> 14766 bytes
wp-content/uploads/2016/03/advantages-1.png | Bin 35716 -> 35751 bytes
wp-content/uploads/2016/03/how-it-works.png | Bin 47916 -> 52599 bytes
.../2016/09/ONI_Architecture-Diagram_1300_v4.png | Bin 431626 -> 449035 bytes
...ng => ONI_Architecture-Diagram_1300_v4_old.png} | Bin
wp-content/uploads/2016/10/iPython-1-300x89.png | Bin 0 -> 13403 bytes
wp-content/uploads/2016/10/iPython-1.png | Bin 0 -> 12682 bytes
44 files changed, 1252 insertions(+), 891 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 4971dc0..e1ee89e 100644
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -125,24 +125,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive date" itemscope itemtype="http://schema.org/WebPage">
@@ -195,7 +177,7 @@
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
@@ -208,7 +190,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
</p>
</section>
@@ -227,13 +209,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -241,10 +226,13 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
- <a href='../../2016/08/'>August 2016</a>
+ <a href='../09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../08/'>August 2016</a>
</li>
<li>
- <a href='../../2016/03/'>March 2016</a>
+ <a href='../03/'>March 2016</a>
</li>
</ul>
</div>
diff --git a/2016/08/index.html b/2016/08/index.html
index 455c751..a1eddf4 100644
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -125,24 +125,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive date" itemscope itemtype="http://schema.org/WebPage">
@@ -195,7 +177,7 @@
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
@@ -223,7 +205,7 @@
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <h3 class="h2 entry-title"><a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
@@ -236,7 +218,7 @@
<section class="entry-content cf">
<p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-open-network-insight-helps-create-well-st [...]
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-apache-spot-helps-create-well-stocked-dat [...]
</p>
</section>
@@ -255,13 +237,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -269,10 +254,13 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
- <a href='../../2016/08/'>August 2016</a>
+ <a href='../09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../08/'>August 2016</a>
</li>
<li>
- <a href='../../2016/03/'>March 2016</a>
+ <a href='../03/'>March 2016</a>
</li>
</ul>
</div>
diff --git a/2016/03/index.html b/2016/09/index.html
similarity index 63%
copy from 2016/03/index.html
copy to 2016/09/index.html
index 4971dc0..006c8f3 100644
--- a/2016/03/index.html
+++ b/2016/09/index.html
@@ -12,33 +12,29 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot 2016 March</title>
+ <title>Apache Spot 2016 September</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
<meta name="viewport" content="width=device-width, initial-scale=1"/>
- <link rel="apple-touch-icon" href="../../wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="../../wp-content/themes/oni/favicon.png">
+ <link rel="apple-touch-icon" href="../../../../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../../../wp-content/themes/oni/favicon.png">
<!--[if IE]>
- <link rel="shortcut icon" href="../../wp-content/themes/oni/favicon.ico">
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/wp-content/themes/oni/favicon.ico">
<![endif]-->
<meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="msapplication-TileImage" content="../../../../wp-content/themes/oni/library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
- <link rel="pingback" href="../../xmlrpc.php">
+ <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="http://spot.incubator.apache.org/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="http://spot.incubator.apache.org/comments/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
"ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
@@ -47,30 +43,24 @@
var c,
d,
e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
+ f = b.createElement("canvas"),
+ g = f.getContext && f.getContext("2d"),
+ h = String.fromCharCode;
+ if (!g || !g.fillText)
return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ switch(g.textBaseline="top",g.font="600 32px Arial",a) {
case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
+ return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ return g.fillText(h(55356, 57221), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
}
return !1
}
@@ -84,7 +74,7 @@
g,
h,
i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
everything : !0,
everythingExceptFlag : !0
},
@@ -116,7 +106,7 @@
<link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
<link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
<!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
<![endif]-->
<link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
@@ -125,24 +115,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive date" itemscope itemtype="http://schema.org/WebPage">
@@ -159,16 +131,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
@@ -189,16 +161,16 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Month: March 2016</h1>
+ <h1 class="page-title">Month: September 2016</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
</time>
</span>
</p>
@@ -208,7 +180,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more &ra [...]
</p>
</section>
@@ -221,19 +193,23 @@
</main>
+
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -241,10 +217,13 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
- <a href='../../2016/08/'>August 2016</a>
+ <a href='../09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../08/'>August 2016</a>
</li>
<li>
- <a href='../../2016/03/'>March 2016</a>
+ <a href='../03/'>March 2016</a>
</li>
</ul>
</div>
diff --git a/apache-spot-3-most-asked-questions/feed/index.html b/apache-spot-3-most-asked-questions/feed/index.html
new file mode 100644
index 0000000..766b30f
--- /dev/null
+++ b/apache-spot-3-most-asked-questions/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot (Incubating): Three Most-Asked Questions</title>
+ <atom:link href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/index.html b/apache-spot-3-most-asked-questions/index.html
similarity index 56%
copy from blog/index.html
copy to apache-spot-3-most-asked-questions/index.html
index 81a376e..e0cbedd 100644
--- a/blog/index.html
+++ b/apache-spot-3-most-asked-questions/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Blog</title>
+ <title>Apache Spot (Incubating): Three Most-Asked Questions</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -33,6 +33,7 @@
<link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Apache Spot: Three Most-Asked Questions Comments Feed" href="../open-network-insight-3-most-asked-questions/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -124,28 +125,14 @@
<script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
<script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="../open-network-insight-3-most-asked-questions/" />
+ <link rel='shortlink' href='../?p=62' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-3-most-asked-questions%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-3-most-asked-questions%2F&format=xml" />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="blog" itemscope itemtype="http://schema.org/WebPage">
+ <body class="single single-post postid-62 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -171,7 +158,7 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../blog/">Blog</a>
</li>
</ul>
@@ -186,64 +173,17 @@
<div id="content">
<div id="inner-content" class="wrap cf">
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-de [...]
- </p>
- </div>
- </section>
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- </article>
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+ <header class="article-header entry-header">
- <header class="article-header">
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating): Three Most-Asked Questions</h1>
- <h1 class="h2 entry-title"><a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-open-network-insight-helps-create-well-s [...]
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h1>
- <p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
</time>
@@ -251,15 +191,52 @@
</p>
</header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more [...]
- </p>
- </div>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.
+ </p>
+ <p>
+ <strong>What Is Apache Spot?</strong>
+ <br />
+ Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security [...]
+ </p>
+ <p>
+ We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an [...]
+ <br />
+ <a href="../wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="../wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="../wp-content/uploads/2016/03/FloCon2015.png 960w, ../wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, ../wp-content/uploads/2016/03/FloCon2015-768x576.png 768w" sizes="(max-width: 960px) 100v [...]
+ </p>
+ <p>
+ The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.
+ </p>
+ <p>
+ <strong>Why Intel?</strong>
+ </p>
+ <p>
+ At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some prett [...]
+ </p>
+ <p>
+ <strong>Why Open Source?</strong>
+ </p>
+ <p>
+ I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.
+ </p>
+ <p>
+ The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuo [...]
+ </p>
+ <p>
+ Fork us on Github!
+ </p>
+ <p>
+ Grant Babb
+ </p>
</section>
+ <footer class="article-footer">
+
+ filed under: <a href="../category/security-analytics/" rel="category tag">Security Analytics</a>
+ <p class="tags">
+ <span class="tags-title">Tags:</span><a href="../tag/github/" rel="tag">github</a>, <a href="../tag/open-network-insight/" rel="tag">open network insight</a>, <a href="../tag/open-source/" rel="tag">open source</a>
+ </p>
+ </footer>
</article>
@@ -271,13 +248,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -285,6 +265,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../2016/08/'>August 2016</a>
</li>
<li>
@@ -314,6 +297,7 @@
</div>
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
<script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
<script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
new file mode 100644
index 0000000..0a44b5d
--- /dev/null
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+ <atom:link href="http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
similarity index 56%
copy from blog/index.html
copy to apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 81a376e..11fb459 100644
--- a/blog/index.html
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Blog</title>
+ <title>Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -33,6 +33,7 @@
<link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure Comments Feed" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -124,28 +125,14 @@
<script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
<script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" />
+ <link rel='shortlink' href='../?p=117' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fopen-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure%2F&format=xml" />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="blog" itemscope itemtype="http://schema.org/WebPage">
+ <body class="single single-post postid-117 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -171,7 +158,7 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../blog/">Blog</a>
</li>
</ul>
@@ -186,39 +173,17 @@
<div id="content">
<div id="inner-content" class="wrap cf">
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-de [...]
- </p>
- </div>
- </section>
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- </article>
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+ <header class="article-header entry-header">
- <header class="article-header">
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</h1>
- <h1 class="h2 entry-title"><a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
<p class="byline entry-meta vcard">
+
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
</time>
@@ -226,40 +191,57 @@
</p>
</header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-open-network-insight-helps-create-well-s [...]
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each attack?
+ </p>
+ <p>
+ Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:
+ </p>
+ <ol>
+ <li>
+ Collect information from each device that is part of the environment.
+ </li>
+ <li>
+ Collect information from the critical infrastructure that is used for most, if not all, of the systems.
+ </li>
+ </ol>
+ <p>
+ This blog will describe the second approach.
+ </p>
+ <p>
+ Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or serv [...]
+ </p>
+ <p>
+ Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.
+ </p>
+ <p>
+ Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?
+ </p>
+ <p>
+ First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
+ </p>
+ <p>
+ Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
</p>
+ <p>
+ Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
+ </p>
+ <p>
+ <strong>But Wait, There’s More</strong>
+ </p>
+ <p>
+ Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
+ </p>
+ <p>
+ This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
+ </p>
+ </section>
+ <footer class="article-footer">
- </header>
+ filed under: <a href="../category/cybersecurity/" rel="category tag">Cybersecurity</a>
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more [...]
- </p>
- </div>
- </section>
+ </footer>
</article>
@@ -271,13 +253,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -285,6 +270,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../2016/08/'>August 2016</a>
</li>
<li>
@@ -314,6 +302,7 @@
</div>
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
<script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
<script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
diff --git a/blog/index.html b/blog/index.html
index 81a376e..859e75e 100644
--- a/blog/index.html
+++ b/blog/index.html
@@ -42,7 +42,8 @@
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
- }; ! function(a, b, c) {
+ };
+ ! function(a, b, c) {
function d(a) {
var c,
d,
@@ -125,24 +126,7 @@
<script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
- </script>
</head>
<body class="blog" itemscope itemtype="http://schema.org/WebPage">
@@ -160,16 +144,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
<a href="../blog/">Blog</a>
@@ -188,11 +172,36 @@
<div id="inner-content" class="wrap cf">
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="article-header">
+
+ <h1 class="h2 entry-title"><a href="../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h1>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+ <div class="m-all t-1of4 d-2of7"></div>
+ <div class="m-all t-3of4 d-5of7">
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more »</a>
+ </p>
+ </div>
+ </section>
+
+ </article>
+
<article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
<header class="article-header">
- <h1 class="h2 entry-title"><a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
+ <h1 class="h2 entry-title"><a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
@@ -206,7 +215,7 @@
<div class="m-all t-1of4 d-2of7"></div>
<div class="m-all t-3of4 d-5of7">
<p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-de [...]
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats- [...]
</p>
</div>
</section>
@@ -217,7 +226,7 @@
<header class="article-header">
- <h1 class="h2 entry-title"><a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
+ <h1 class="h2 entry-title"><a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
@@ -231,18 +240,18 @@
<div class="m-all t-1of4 d-2of7"></div>
<div class="m-all t-3of4 d-5of7">
<p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-open-network-insight-helps-create-well-s [...]
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-apache-spot-helps-create-well-stocked-da [...]
</p>
</div>
</section>
</article>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
<header class="article-header">
- <h1 class="h2 entry-title"><a href="../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h1>
+ <h1 class="h2 entry-title"><a href="../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h1>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
@@ -256,7 +265,7 @@
<div class="m-all t-1of4 d-2of7"></div>
<div class="m-all t-3of4 d-5of7">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more [...]
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
</p>
</div>
</section>
@@ -271,13 +280,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -285,6 +297,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/category/cybersecurity/feed/index.html b/category/cybersecurity/feed/index.html
index 01c43db..fac6f3a 100644
--- a/category/cybersecurity/feed/index.html
+++ b/category/cybersecurity/feed/index.html
@@ -19,14 +19,14 @@
<item>
<title>Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
- <link>http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
- <comments>http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
+ <link>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <comments>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
<pubDate>Mon, 08 Aug 2016 08:00:32 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Cybersecurity]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=117</guid>
- <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-net [...]
+ <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-dete [...]
<content:encoded><![CDATA[<p>The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each att [...]
<p>Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:</p>
<ol>
@@ -41,10 +41,10 @@
<p>Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenarios. With Apache Spot, attacks that [...]
<p>Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.</p>
<p><strong>But Wait, There’s More</strong></p>
-<p>Check out “<a href="http://spot.incubator.apache.org/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
+<p>Check out “<a href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
<p>This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 676bc20..7b440f1 100644
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Cybersecurity</title>
+ <title>Cybersecurity</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -126,24 +126,7 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
- </script>
</head>
<body class="archive category category-cybersecurity category-9" itemscope itemtype="http://schema.org/WebPage">
@@ -196,7 +179,7 @@
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
@@ -209,7 +192,7 @@
<section class="entry-content cf">
<p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-det [...]
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-t [...]
</p>
</section>
@@ -228,13 +211,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -242,6 +228,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/category/data-science/feed/index.html b/category/data-science/feed/index.html
new file mode 100644
index 0000000..e2c33f6
--- /dev/null
+++ b/category/data-science/feed/index.html
@@ -0,0 +1,62 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Data Science – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/category/data-science/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Fri, 07 Oct 2016 00:20:13 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Jupyter Notebooks for Data Analysis</title>
+ <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Data Science]]></category>
+ <category><![CDATA[Ipython Notebooks]]></category>
+ <category><![CDATA[Threat Analysis Tools]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis" [...]
+ <content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
+<p>The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – thus the [...]
+<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
+<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
+<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
+<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
+<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
+<p>If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.</p>
+<p><strong><em>What? </em></strong></p>
+<p>Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.</p>
+<p><strong><em>Who?</em></strong></p>
+<p>Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a long way when identifying a threat.</p>
+<p><strong><em>When?</em></strong></p>
+<p>To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.</p>
+<p><strong><em>Where?</em></strong></p>
+<p>When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.</p>
+<p><strong><em>Why?</em></strong></p>
+<p>This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.</p>
+<p><strong>How to Get Answers to the Five Ws Questions</strong></p>
+<p>All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.</p>
+<p>Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.</p>
+<p><strong>Wrap Up</strong></p>
+<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
+<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/2016/03/index.html b/category/data-science/index.html
similarity index 68%
copy from 2016/03/index.html
copy to category/data-science/index.html
index 4971dc0..d416f07 100644
--- a/2016/03/index.html
+++ b/category/data-science/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot 2016 March</title>
+ <title>Apache Spot Data Science</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -27,18 +27,15 @@
<meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
- <link rel="pingback" href="../../xmlrpc.php">
+ <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Data Science Category Feed" href="../../category/data-science/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
"ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
@@ -47,30 +44,24 @@
var c,
d,
e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
+ f = b.createElement("canvas"),
+ g = f.getContext && f.getContext("2d"),
+ h = String.fromCharCode;
+ if (!g || !g.fillText)
return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ switch(g.textBaseline="top",g.font="600 32px Arial",a) {
case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
+ return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ return g.fillText(h(55356, 57221), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
}
return !1
}
@@ -84,7 +75,7 @@
g,
h,
i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
everything : !0,
everythingExceptFlag : !0
},
@@ -116,7 +107,7 @@
<link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
<link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
<!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
<![endif]-->
<link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
@@ -125,27 +116,9 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
+ <body class="archive category category-data-science category-11" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -159,16 +132,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
@@ -189,16 +162,16 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Month: March 2016</h1>
+ <h1 class="page-title">Category: Data Science</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
</time>
</span>
</p>
@@ -208,7 +181,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
</p>
</section>
@@ -227,13 +200,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -241,6 +217,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/category/ipython-notebooks/feed/index.html b/category/ipython-notebooks/feed/index.html
new file mode 100644
index 0000000..1935eed
--- /dev/null
+++ b/category/ipython-notebooks/feed/index.html
@@ -0,0 +1,62 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Ipython Notebooks – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/category/ipython-notebooks/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Fri, 07 Oct 2016 00:20:13 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Jupyter Notebooks for Data Analysis</title>
+ <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Data Science]]></category>
+ <category><![CDATA[Ipython Notebooks]]></category>
+ <category><![CDATA[Threat Analysis Tools]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis" [...]
+ <content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
+<p>The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – thus the [...]
+<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
+<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
+<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
+<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
+<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
+<p>If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.</p>
+<p><strong><em>What? </em></strong></p>
+<p>Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.</p>
+<p><strong><em>Who?</em></strong></p>
+<p>Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a long way when identifying a threat.</p>
+<p><strong><em>When?</em></strong></p>
+<p>To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.</p>
+<p><strong><em>Where?</em></strong></p>
+<p>When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.</p>
+<p><strong><em>Why?</em></strong></p>
+<p>This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.</p>
+<p><strong>How to Get Answers to the Five Ws Questions</strong></p>
+<p>All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.</p>
+<p>Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.</p>
+<p><strong>Wrap Up</strong></p>
+<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
+<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/2016/03/index.html b/category/ipython-notebooks/index.html
similarity index 69%
copy from 2016/03/index.html
copy to category/ipython-notebooks/index.html
index 4971dc0..2432f5e 100644
--- a/2016/03/index.html
+++ b/category/ipython-notebooks/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot 2016 March</title>
+ <title>Apache Spot Ipython Notebooks</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -27,18 +27,15 @@
<meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
- <link rel="pingback" href="../../xmlrpc.php">
+ <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Ipython Notebooks Category Feed" href="../../category/ipython-notebooks/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
"ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
@@ -47,30 +44,24 @@
var c,
d,
e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
+ f = b.createElement("canvas"),
+ g = f.getContext && f.getContext("2d"),
+ h = String.fromCharCode;
+ if (!g || !g.fillText)
return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ switch(g.textBaseline="top",g.font="600 32px Arial",a) {
case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
+ return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ return g.fillText(h(55356, 57221), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
}
return !1
}
@@ -84,7 +75,7 @@
g,
h,
i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
everything : !0,
everythingExceptFlag : !0
},
@@ -125,27 +116,9 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
+ <body class="archive category category-ipython-notebooks category-10" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -159,16 +132,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
@@ -189,16 +162,16 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Month: March 2016</h1>
+ <h1 class="page-title">Category: Ipython Notebooks</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
</time>
</span>
</p>
@@ -208,7 +181,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
</p>
</section>
@@ -227,13 +200,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -241,6 +217,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/category/security-analytics/feed/index.html b/category/security-analytics/feed/index.html
index 690f185..c3706f5 100644
--- a/category/security-analytics/feed/index.html
+++ b/category/security-analytics/feed/index.html
@@ -19,8 +19,8 @@
<item>
<title>Apache Spot: Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,7 +29,7 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
@@ -40,11 +40,11 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
<p><strong>Why Open Source?</strong></p>
<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
-<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/apache-spot-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cyber-attac [...]
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index ea98511..9c716d8 100644
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Security Analytics</title>
+ <title>Security Analytics</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -126,24 +126,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive category category-security-analytics category-4" itemscope itemtype="http://schema.org/WebPage">
@@ -161,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
@@ -192,11 +174,11 @@
<h1 class="page-title">Category: Security Analytics</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
@@ -209,7 +191,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
</p>
</section>
@@ -228,13 +210,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -242,6 +227,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/category/threat-analysis-tools/feed/index.html b/category/threat-analysis-tools/feed/index.html
new file mode 100644
index 0000000..0e0f486
--- /dev/null
+++ b/category/threat-analysis-tools/feed/index.html
@@ -0,0 +1,62 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:wfw="http://wellformedweb.org/CommentAPI/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+ xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
+ >
+
+<channel>
+ <title>Threat Analysis Tools – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/category/threat-analysis-tools/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org</link>
+ <description></description>
+ <lastBuildDate>Fri, 07 Oct 2016 00:20:13 +0000</lastBuildDate>
+ <language>en-US</language>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+ <item>
+ <title>Jupyter Notebooks for Data Analysis</title>
+ <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Data Science]]></category>
+ <category><![CDATA[Ipython Notebooks]]></category>
+ <category><![CDATA[Threat Analysis Tools]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis" [...]
+ <content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
+<p>The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – thus the [...]
+<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
+<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
+<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
+<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
+<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
+<p>If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.</p>
+<p><strong><em>What? </em></strong></p>
+<p>Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.</p>
+<p><strong><em>Who?</em></strong></p>
+<p>Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a long way when identifying a threat.</p>
+<p><strong><em>When?</em></strong></p>
+<p>To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.</p>
+<p><strong><em>Where?</em></strong></p>
+<p>When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.</p>
+<p><strong><em>Why?</em></strong></p>
+<p>This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.</p>
+<p><strong>How to Get Answers to the Five Ws Questions</strong></p>
+<p>All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.</p>
+<p>Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.</p>
+<p><strong>Wrap Up</strong></p>
+<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
+<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+ </channel>
+</rss>
diff --git a/2016/03/index.html b/category/threat-analysis-tools/index.html
similarity index 68%
copy from 2016/03/index.html
copy to category/threat-analysis-tools/index.html
index 4971dc0..0d13dd8 100644
--- a/2016/03/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot 2016 March</title>
+ <title>Apache Spot Threat Analysis Tools</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -27,18 +27,15 @@
<meta name="msapplication-TileImage" content="../../wp-content/themes/oni/library/images/win8-tile-icon.png">
<meta name="theme-color" content="#121212">
- <link rel="pingback" href="../../xmlrpc.php">
+ <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Threat Analysis Tools Category Feed" href="../../category/threat-analysis-tools/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
"ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
@@ -47,30 +44,24 @@
var c,
d,
e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
+ f = b.createElement("canvas"),
+ g = f.getContext && f.getContext("2d"),
+ h = String.fromCharCode;
+ if (!g || !g.fillText)
return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
+ switch(g.textBaseline="top",g.font="600 32px Arial",a) {
case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
+ return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
+ return g.fillText(h(55356, 57221), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
+ return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
+ return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
}
return !1
}
@@ -84,7 +75,7 @@
g,
h,
i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
+ for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
everything : !0,
everythingExceptFlag : !0
},
@@ -116,7 +107,7 @@
<link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
<link rel='stylesheet' id='bones-stylesheet-css' href='../../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
<!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='../../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
<![endif]-->
<link rel='stylesheet' id='mm-css-css' href='../../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
@@ -125,27 +116,9 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="archive date" itemscope itemtype="http://schema.org/WebPage">
+ <body class="archive category category-threat-analysis-tools category-9" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -159,16 +132,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
</li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
@@ -189,16 +162,16 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="page-title">Month: March 2016</h1>
+ <h1 class="page-title">Category: Threat Analysis Tools</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
<p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
</time>
</span>
</p>
@@ -208,7 +181,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read more & [...]
</p>
</section>
@@ -227,13 +200,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -241,6 +217,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/category/uncategorized/feed/index.html b/category/uncategorized/feed/index.html
index 123b112..4d92163 100644
--- a/category/uncategorized/feed/index.html
+++ b/category/uncategorized/feed/index.html
@@ -9,7 +9,7 @@
<channel>
<title>Uncategorized – Apache Spot</title>
- <atom:link href="http://spot.incubator.apache.org//category/uncategorized/feed/" rel="self" type="application/rss+xml" />
+ <atom:link href="http://spot.incubator.apache.org/category/uncategorized/feed/" rel="self" type="application/rss+xml" />
<link>http://spot.incubator.apache.org/</link>
<description></description>
<lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
@@ -17,19 +17,59 @@
<sy:updatePeriod>hourly</sy:updatePeriod>
<sy:updateFrequency>1</sy:updateFrequency>
+ <item>
+ <title>Jupyter Notebooks for Data Analysis</title>
+ <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Uncategorized]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analy [...]
+ <content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
+<p>The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – th [...]
+<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
+<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
+<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
+<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
+<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
+<p>If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.</p>
+<p><strong><em>What? </em></strong></p>
+<p>Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.</p>
+<p><strong><em>Who?</em></strong></p>
+<p>Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a long way when identifying a threat.</p>
+<p><strong><em>When?</em></strong></p>
+<p>To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.</p>
+<p><strong><em>Where?</em></strong></p>
+<p>When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.</p>
+<p><strong><em>Why?</em></strong></p>
+<p>This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.</p>
+<p><strong>How to Get Answers to the Five Ws Questions</strong></p>
+<p>All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.</p>
+<p>Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.</p>
+<p><strong>Wrap Up</strong></p>
+<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
+<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+
<item>
- <title>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
- <link>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
- <comments>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
+ <title>How Apache (Incubating) Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <link>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <comments>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
<pubDate>Mon, 08 Aug 2016 07:59:41 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
- <guid isPermaLink="false">http://spot.incubator.apache.org//?p=113</guid>
- <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//how-open-network-insight-helps-c [...]
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=113</guid>
+ <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well [...]
<content:encoded><![CDATA[<p>About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what order [...]
<p>Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.</p>
-<a href="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org//wp-content/uploads/201 [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org/wp-content/uploads/2016/09 [...]
<h3><strong>Apache Spot Core Components</strong></h3>
<p>The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.</p>
<p>In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and ensures that resources can grow [...]
@@ -40,7 +80,7 @@
<h3><strong>Customizable Open Source</strong></h3>
<p>Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index ef9156d..96f1ad4 100644
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -127,24 +127,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive category category-uncategorized category-1" itemscope itemtype="http://schema.org/WebPage">
@@ -162,16 +144,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
@@ -192,12 +174,13 @@
<main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
<h1 class="page-title">Category: Uncategorized</h1>
+
<article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <h3 class="h2 entry-title"><a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
@@ -210,7 +193,7 @@
<section class="entry-content cf">
<p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-open-network-insight-helps-create-well-st [...]
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../how-apache-spot-helps-create-well-stocked-dat [...]
</p>
</section>
@@ -222,20 +205,23 @@
</article>
</main>
-
+
<div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
<div id="recent-posts-2" class="widget widget_recent_entries">
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -243,6 +229,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/feed/index.html b/feed/index.html
index 881aa0e..29f0268 100644
--- a/feed/index.html
+++ b/feed/index.html
@@ -9,7 +9,7 @@
<channel>
<title>Apache Spot</title>
- <atom:link href="http://spot.incubator.apache.org//feed/" rel="self" type="application/rss+xml" />
+ <atom:link href="http://spot.incubator.apache.org/feed/" rel="self" type="application/rss+xml" />
<link>http://spot.incubator.apache.org/</link>
<description></description>
<lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
@@ -17,16 +17,56 @@
<sy:updatePeriod>hourly</sy:updatePeriod>
<sy:updateFrequency>1</sy:updateFrequency>
+ <item>
+ <title>Jupyter Notebooks for Data Analysis</title>
+ <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
+ <comments>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/#respond</comments>
+ <pubDate>Thu, 22 Sep 2016 21:28:12 +0000</pubDate>
+ <dc:creator><![CDATA[oni-admin]]></dc:creator>
+ <category><![CDATA[Uncategorized]]></category>
+
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=136</guid>
+ <description><![CDATA[Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analy [...]
+ <content:encoded><![CDATA[<p><strong>Why Does Apache Spot Include iPython notebooks? </strong></p>
+<p>The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an interactive environment – th [...]
+<p>The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.</p>
+<p>Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.</p>
+<img src="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1.png 361w, http://spot.incubator.apache.org/wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+<p><strong>IPython with Apache Spot for Network Threat Detection</strong></p>
+<p><em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em></p>
+<p>Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to get a new data subset and here is w [...]
+<p>If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.</p>
+<p><strong><em>What? </em></strong></p>
+<p>Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.</p>
+<p><strong><em>Who?</em></strong></p>
+<p>Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a long way when identifying a threat.</p>
+<p><strong><em>When?</em></strong></p>
+<p>To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.</p>
+<p><strong><em>Where?</em></strong></p>
+<p>When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.</p>
+<p><strong><em>Why?</em></strong></p>
+<p>This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.</p>
+<p><strong>How to Get Answers to the Five Ws Questions</strong></p>
+<p>All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.</p>
+<p>Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.</p>
+<p><strong>Wrap Up</strong></p>
+<p>This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.</p>
+<p>We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.</p>
+]]></content:encoded>
+ <wfw:commentRss>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/</wfw:commentRss>
+ <slash:comments>0</slash:comments>
+ </item>
+
<item>
- <title>Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
- <link>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
- <comments>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
+ <title>Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</title>
+ <link>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/</link>
+ <comments>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/#respond</comments>
<pubDate>Mon, 08 Aug 2016 08:00:32 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Cybersecurity]]></category>
- <guid isPermaLink="false">http://spot.incubator.apache.org//?p=117</guid>
- <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-ne [...]
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=117</guid>
+ <description><![CDATA[The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-dete [...]
<content:encoded><![CDATA[<p>The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each att [...]
<p>Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:</p>
<ol>
@@ -41,25 +81,25 @@
<p>Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenarios. With Apache Spot, attacks that [...]
<p>Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.</p>
<p><strong>But Wait, There’s More</strong></p>
-<p>Check out “<a href="http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
+<p>Check out “<a href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.</p>
<p>This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org//open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
<title>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
- <link>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
- <comments>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
+ <link>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <comments>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/#respond</comments>
<pubDate>Mon, 08 Aug 2016 07:59:41 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Uncategorized]]></category>
- <guid isPermaLink="false">http://spot.incubator.apache.org//?p=113</guid>
- <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//how-open-network-insight-helps-c [...]
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=113</guid>
+ <description><![CDATA[About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well [...]
<content:encoded><![CDATA[<p>About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what order [...]
<p>Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.</p>
-<a href="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org//wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org//wp-content/uploads/201 [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, http://spot.incubator.apache.org/wp-content/uploads/2016/09 [...]
<h3><strong>Apache Spot Core Components</strong></h3>
<p>The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.</p>
<p>In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and ensures that resources can grow [...]
@@ -70,13 +110,13 @@
<h3><strong>Customizable Open Source</strong></h3>
<p>Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org//how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
<item>
- <title>Apache Spot: Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/#respond</comments>
+ <title>Apache Spot (Incubating): Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -84,23 +124,23 @@
<category><![CDATA[open network insight]]></category>
<category><![CDATA[open source]]></category>
- <guid isPermaLink="false">http://spot.incubator.apache.org//?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions [...]
+ <guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
<p>We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an event that says “this attac [...]
-<a href="http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org//wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, h [...]
+<a href="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png" alt="open source packet and flow analytics" width="960" height="720" srcset="http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015.png 960w, http://spot.incubator.apache.org/wp-content/uploads/2016/03/FloCon2015-300x225.png 300w, http: [...]
<p>The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.</p>
<p><strong>Why Intel?</strong></p>
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
<p><strong>Why Open Source?</strong></p>
<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
-<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/apache-spot-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cyber-attac [...]
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org//open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html
new file mode 100644
index 0000000..62b7e33
--- /dev/null
+++ b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
+ <atom:link href="http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/blog/index.html b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
similarity index 60%
copy from blog/index.html
copy to how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 81a376e..4249e9e 100644
--- a/blog/index.html
+++ b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Blog</title>
+ <title>How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -33,6 +33,7 @@
<link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights Comments Feed" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -124,28 +125,14 @@
<script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
<script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" />
+ <link rel='shortlink' href='../?p=113' />
+ <link rel="alternate" type="application/json+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fhow-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="../wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2Fhow-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights%2F&format=xml" />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="blog" itemscope itemtype="http://schema.org/WebPage">
+ <body class="single single-post postid-113 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -171,7 +158,7 @@
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
</li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current-menu-item page_item page-item-10 current_page_item current_page_parent menu-item-13">
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../blog/">Blog</a>
</li>
</ul>
@@ -186,39 +173,17 @@
<div id="content">
<div id="inner-content" class="wrap cf">
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-de [...]
- </p>
- </div>
- </section>
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- </article>
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+ <header class="article-header entry-header">
- <header class="article-header">
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
- <h1 class="h2 entry-title"><a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h1>
<p class="byline entry-meta vcard">
+
<time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
August 8, 2016
</time>
@@ -226,40 +191,39 @@
</p>
</header>
-
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../how-open-network-insight-helps-create-well-s [...]
- </p>
- </div>
- </section>
-
- </article>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
-
- <header class="article-header">
-
- <h1 class="h2 entry-title"><a href="../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h1>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
+ </p>
+ <p>
+ Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
+ </p>
+ <a href="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png"><img src="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" width="1300" height="675" class="alignnone size-full wp-image-114" srcset="../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png 1300w, ../wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4-300x156.png 300w, ../wp-content/uploads/2016/09/ONI_Ar [...]
+ <h3><strong>Apache Spot Core Components</strong></h3>
+ <p>
+ The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
+ </p>
+ <p>
+ In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
</p>
+ <h3><strong>Operational Analytics</strong></h3>
+ <p>
+ As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
+ </p>
+ <h3><strong>Visualizing Results</strong></h3>
+ <p>
+ The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
+ </p>
+ <h3><strong>Customizable Open Source</strong></h3>
+ <p>
+ Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
+ </p>
+ </section>
+ <footer class="article-footer">
- </header>
+ filed under: <a href="../category/uncategorized/" rel="category tag">Uncategorized</a>
- <section class="entry-content cf">
- <div class="m-all t-1of4 d-2of7"></div>
- <div class="m-all t-3of4 d-5of7">
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more [...]
- </p>
- </div>
- </section>
+ </footer>
</article>
@@ -271,13 +235,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -285,6 +252,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../2016/08/'>August 2016</a>
</li>
<li>
@@ -314,6 +284,7 @@
</div>
+ <script type='text/javascript' src='../wp-includes/js/comment-reply.min.js'></script>
<script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
<script type='text/javascript' src='../wp-includes/js/wp-embed.min.js'></script>
diff --git a/index.html b/index.html
index 31a6a1e..360738c 100644
--- a/index.html
+++ b/index.html
@@ -42,7 +42,8 @@
"source" : {
"concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
}
- }; ! function(a, b, c) {
+ };
+ ! function(a, b, c) {
function d(a) {
var c,
d,
@@ -129,24 +130,6 @@
<link rel="alternate" type="application/json+oembed" href="wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2F" />
<link rel="alternate" type="text/xml+oembed" href="wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2F&format=xml" />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="home page page-id-8 page-template-default" itemscope itemtype="http://schema.org/WebPage">
@@ -354,45 +337,6 @@
<p class="btn-margin center">
Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
</p>
- <!--
- <div class="quotes">
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
- <h3>Senior Analyst</h3>
- </div>
- <div class="table-cell">
- <p>...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”</p> </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
- <h3>Junior Analyst</h3>
- </div>
- <div class="table-cell">
- <p>...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
- </p> </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
- <h3>Decision Maker</h3>
- </div>
- <div class="table-cell">
- <p>...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
- </p> </div>
- </div>
- </div>
-
- </div>-->
</div>
</div>
@@ -447,43 +391,6 @@
</div>
- <!--
- <div class="m-all t-1of2 d-4of7 left">
- <img src="wp-content/uploads/2016/03/use-case-graphic.png" alt="" />
- </div>
- <div class="m-all t-1of2 d-3of7 right">
- <div class="table">
- <div class="table-row">
- <div class="table-cell number">
- <img src="wp-content/themes/oni/library/images/one.png" alt="" />
- </div>
- <div class="table-cell">
- <p>Deliver suspicious connections in <strong>ranked</strong> order with multiple data points such as time, traffic flow, and more.</p> </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell number">
- <img src="wp-content/themes/oni/library/images/two.png" alt="" />
- </div>
- <div class="table-cell">
- <p>Human input helps the system evolve. <strong>Quickly eliminate false positives from the lineup.</strong></p> </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell number">
- <img src="wp-content/themes/oni/library/images/three.png" alt="" />
- </div>
- <div class="table-cell">
- <p>And make every item on the list <strong>worth your time</strong> to investigate.</p> </div>
- </div>
- </div>
-
- </div> -->
-
</div>
<div class="arrow">
@@ -498,7 +405,7 @@
<div id="more-info">
<div class="wrap cf">
<p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/onihadoop" target="_blank"><span class="icon-twitter"></span></a>
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://open-network-insight.org:3000/" target="_blank"><img src="wp-content/themes/oni/library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
</p>
<p>
diff --git a/jupyter-notebooks-for-data-analysis/feed/index.html b/jupyter-notebooks-for-data-analysis/feed/index.html
new file mode 100644
index 0000000..0ce0406
--- /dev/null
+++ b/jupyter-notebooks-for-data-analysis/feed/index.html
@@ -0,0 +1,18 @@
+<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
+ xmlns:content="http://purl.org/rss/1.0/modules/content/"
+ xmlns:dc="http://purl.org/dc/elements/1.1/"
+ xmlns:atom="http://www.w3.org/2005/Atom"
+ xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
+
+ >
+<channel>
+ <title>Comments on: Jupyter Notebooks for Data Analysis</title>
+ <atom:link href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/" rel="self" type="application/rss+xml" />
+ <link>http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/</link>
+ <description></description>
+ <lastBuildDate></lastBuildDate>
+ <sy:updatePeriod>hourly</sy:updatePeriod>
+ <sy:updateFrequency>1</sy:updateFrequency>
+
+</channel>
+</rss>
diff --git a/jupyter-notebooks-for-data-analysis/index.html b/jupyter-notebooks-for-data-analysis/index.html
new file mode 100644
index 0000000..cbd0e04
--- /dev/null
+++ b/jupyter-notebooks-for-data-analysis/index.html
@@ -0,0 +1,333 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Jupyter Notebooks for Data Analysis</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../wp-content/themes/oni/library/images/apple-touch-icon.png">
+ <link rel="icon" href="../wp-content/themes/oni/favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org../wp-content/themes/oni/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../wp-content/themes/oni/library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
+
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="http://spot.incubator.apache.org/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="http://spot.incubator.apache.org/comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Jupyter Notebooks for Data Analysis Comments Feed" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/" />
+ <script type="text/javascript">
+ window._wpemojiSettings = {
+ "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
+ "ext" : ".png",
+ "source" : {
+ "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
+ }
+ }; ! function(a, b, c) {
+ function d(a) {
+ var c,
+ d,
+ e,
+ f = b.createElement("canvas"),
+ g = f.getContext && f.getContext("2d"),
+ h = String.fromCharCode;
+ if (!g || !g.fillText)
+ return !1;
+ switch(g.textBaseline="top",g.font="600 32px Arial",a) {
+ case"flag":
+ return g.fillText(h(55356, 56806, 55356, 56826), 0, 0), f.toDataURL().length > 3e3;
+ case"diversity":
+ return g.fillText(h(55356, 57221), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ d = c[0] + "," + c[1] + "," + c[2] + "," + c[3], g.fillText(h(55356, 57221, 55356, 57343), 0, 0),
+ c = g.getImageData(16, 16, 1, 1).data,
+ e = c[0] + "," + c[1] + "," + c[2] + "," + c[3], d !== e;
+ case"simple":
+ return g.fillText(h(55357, 56835), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0];
+ case"unicode8":
+ return g.fillText(h(55356, 57135), 0, 0), 0 !== g.getImageData(16,16,1,1).data[0]
+ }
+ return !1
+ }
+
+ function e(a) {
+ var c = b.createElement("script");
+ c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
+ }
+
+ var f,
+ g,
+ h,
+ i;
+ for ( i = Array("simple", "flag", "unicode8", "diversity"), c.supports = {
+ everything : !0,
+ everythingExceptFlag : !0
+ },
+ h = 0; h < i.length; h++)
+ c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
+ c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
+ c.DOMReady = !0
+ }, c.supports.everything || ( g = function() {
+ c.readyCallback()
+ }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
+ "complete" === b.readyState && c.readyCallback()
+ })),
+ f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
+ }(window, document, window._wpemojiSettings);
+ </script>
+ <style type="text/css">
+ img.wp-smiley, img.emoji {
+ display: inline !important;
+ border: none !important;
+ box-shadow: none !important;
+ height: 1em !important;
+ width: 1em !important;
+ margin: 0 .07em !important;
+ vertical-align: -0.1em !important;
+ background: none !important;
+ padding: 0 !important;
+ }
+ </style>
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org../wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery.js'></script>
+ <script type='text/javascript' src='../wp-includes/js/jquery/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
+ <link rel='https://api.w.org/' href='../wp-json/' />
+ <link rel="canonical" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/" />
+ <!--<link rel='shortlink' href='http://spot.incubator.apache.org/?p=136' />-->
+ <link rel="alternate" type="application/json+oembed" href="http://spot.incubator.apache.org/wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fjupyter-notebooks-for-data-analysis%2F" />
+ <link rel="alternate" type="text/xml+oembed" href="http://spot.incubator.apache.org/wp-json/oembed/1.0/embed?url=http%3A%2F%2Fopen-network-insight.org%2Fjupyter-notebooks-for-data-analysis%2F&format=xml" />
+
+
+ </head>
+
+ <body class="single single-post postid-136 single-format-standard" itemscope itemtype="http://schema.org/WebPage">
+
+ <div id="container">
+
+ <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="../wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
+ </p>
+
+ <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ </li>
+ <li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ </li>
+ <li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
+ <a href="../blog/">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Jupyter Notebooks for Data Analysis</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ <strong>Why Does Apache Spot Include iPython notebooks? </strong>
+ </p>
+ <p>
+ The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an i [...]
+ </p>
+ <p>
+ The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.
+ </p>
+ <p>
+ Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.
+ </p>
+ <img src="../wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="../wp-content/uploads/2016/10/iPython-1.png 361w, ../wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
+ <p>
+ <strong>IPython with Apache Spot for Network Threat Detection</strong>
+ </p>
+ <p>
+ <em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em>
+ </p>
+ <p>
+ Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to ge [...]
+ </p>
+ <p>
+ If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.
+ </p>
+ <p>
+ <strong><em>What? </em></strong>
+ </p>
+ <p>
+ Maybe there’s been an increase in the logs collected by the system, which indicates abnormal amounts of communication in your network. Or, the amount of POST requests in your network have risen overnight. This is the mystery that needs to be solved by researching through the anomalies previously detected by ML.
+ </p>
+ <p>
+ <strong><em>Who?</em></strong>
+ </p>
+ <p>
+ Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a [...]
+ </p>
+ <p>
+ <strong><em>When?</em></strong>
+ </p>
+ <p>
+ To have a broader visibility on the attack, you can customize the queries on the Threat investigation notebook to review the data through a wider time lapse – instead of just checking through the current day. With this, you could find an increase of a certain type of requests to one (or many) URIs and predict its future behavior.
+ </p>
+ <p>
+ <strong><em>Where?</em></strong>
+ </p>
+ <p>
+ When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.
+ </p>
+ <p>
+ <strong><em>Why?</em></strong>
+ </p>
+ <p>
+ This answer to “why” will depend highly on the result of the analysis. For instance, an excessive amount of POST requests from one machine inside the network to an unidentified URI can indicate a data mining attack. Tracing back to patient zero, you can find that this could have originated with a phishing email, malicious software installed by an employee or a one-time visitor’s infected machine that connected to your network.
+ </p>
+ <p>
+ <strong>How to Get Answers to the Five Ws Questions</strong>
+ </p>
+ <p>
+ All of the previous questions can be answered by looking at the raw data collected. Although performing elaborated queries directly to your database can seem tempting, this type of analysis with Hive, or even Impala, can be very time consuming. A better approach would be to use Pandas to read and transform your dataset into a relational structured dataframe. This lets you work with as if it were an offline structured relational database.
+ </p>
+ <p>
+ Once you have your desired results and data subsets, you can use MatplotLib to easily graph your findings. (We cover this subject in more depth in another post.) Another advantage of the notebook is that you can download it as HTML or a PDF file to store locally and use it in a presentation – or just keep it for future reference.
+ </p>
+ <p>
+ <strong>Wrap Up</strong>
+ </p>
+ <p>
+ This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.
+ </p>
+ <p>
+ We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.
+ </p>
+ </section>
+
+ <footer class="article-footer">
+
+ filed under: <a href="../category/data-science/" rel="category tag">Data Science</a>, <a href="../category/ipython-notebooks/" rel="category tag">Ipython Notebooks</a>, <a href="../category/threat-analysis-tools/" rel="category tag">Threat Analysis Tools</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <nav role="navigation"></nav>
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+
+ <script type='text/javascript' src='/wp-includes/js/comment-reply.min.js'></script>
+ <script type='text/javascript' src='../wp-content/themes/oni/library/js/scripts.js'></script>
+ <script type='text/javascript' src='/wp-includes/js/wp-embed.min.js'></script>
+
+ </body>
+
+</html>
+<!-- end of site. what a ride! -->
diff --git a/tag/github/feed/index.html b/tag/github/feed/index.html
index f385614..71bcefa 100644
--- a/tag/github/feed/index.html
+++ b/tag/github/feed/index.html
@@ -18,9 +18,9 @@
<sy:updateFrequency>1</sy:updateFrequency>
<item>
- <title>Apache Spot: Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <title>Apache Spot (Incubating): Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,7 +29,7 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
@@ -40,11 +40,11 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
<p><strong>Why Open Source?</strong></p>
<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
-<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/apache-spot-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cyber-attac [...]
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/tag/github/index.html b/tag/github/index.html
index a084a84..1d36a96 100644
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot github</title>
+ <title>Github</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -126,24 +126,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive tag tag-github tag-6" itemscope itemtype="http://schema.org/WebPage">
@@ -161,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
@@ -192,11 +174,11 @@
<h1 class="page-title">Tag: github</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
@@ -209,7 +191,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
</p>
</section>
@@ -228,13 +210,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -242,6 +227,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/tag/open-network-insight/feed/index.html b/tag/open-network-insight/feed/index.html
index e9db2f3..b30ebf2 100644
--- a/tag/open-network-insight/feed/index.html
+++ b/tag/open-network-insight/feed/index.html
@@ -8,8 +8,8 @@
>
<channel>
- <title>open network insight – Apache Spot</title>
- <atom:link href="http://spot.incubator.apache.org/tag/open-network-insight/feed/" rel="self" type="application/rss+xml" />
+ <title>Open Network Insight – Apache Spot</title>
+ <atom:link href="http://spot.incubator.apache.org/tag/apache-spot/feed/" rel="self" type="application/rss+xml" />
<link>http://spot.incubator.apache.org</link>
<description></description>
<lastBuildDate>Tue, 27 Sep 2016 18:37:15 +0000</lastBuildDate>
@@ -18,9 +18,9 @@
<sy:updateFrequency>1</sy:updateFrequency>
<item>
- <title>Apache Spot: Three Most-Asked Questions</title>
- <link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
- <comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
+ <title>Apache Spot (Incubating): Three Most-Asked Questions</title>
+ <link>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/</link>
+ <comments>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
<dc:creator><![CDATA[oni-admin]]></dc:creator>
<category><![CDATA[Security Analytics]]></category>
@@ -29,7 +29,7 @@
<category><![CDATA[open source]]></category>
<guid isPermaLink="false">http://spot.incubator.apache.org/?p=62</guid>
- <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions" [...]
+ <description><![CDATA[While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that... <a class="excerpt-read-more" href="http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read mor [...]
<content:encoded><![CDATA[<p>While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.</p>
<p><strong>What Is Apache Spot?</strong><br />
Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security and get a math degree.</p>
@@ -40,11 +40,11 @@ Apache Spot is an open source, flow and packet analytics solution built on Hadoo
<p>At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some pretty cool analytics efforts of their [...]
<p><strong>Why Open Source?</strong></p>
<p>I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.</p>
-<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cy [...]
+<p>The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/apache-spot-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuously-predict-detect-and-combat-cyber-attac [...]
<p>Fork us on Github!</p>
<p>Grant Babb</p>
]]></content:encoded>
- <wfw:commentRss>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/feed/</wfw:commentRss>
+ <wfw:commentRss>http://spot.incubator.apache.org/apache-spot-3-most-asked-questions/feed/</wfw:commentRss>
<slash:comments>0</slash:comments>
</item>
</channel>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 0b20aed..64c6c02 100644
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot open network insight</title>
+ <title>Open Network Insight</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -33,7 +33,7 @@
<link rel='dns-prefetch' href='//s.w.org' />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
<link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » open network insight Tag Feed" href="../../tag/open-network-insight/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » open network insight Tag Feed" href="../../tag/apache-spot/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -126,27 +126,9 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
- <body class="archive tag tag-open-network-insight tag-7" itemscope itemtype="http://schema.org/WebPage">
+ <body class="archive tag tag-apache-spot tag-7" itemscope itemtype="http://schema.org/WebPage">
<div id="container">
@@ -161,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
@@ -192,11 +174,11 @@
<h1 class="page-title">Tag: open network insight</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
@@ -209,7 +191,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
</p>
</section>
@@ -228,13 +210,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -242,6 +227,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/tag/open-source/feed/index.html b/tag/open-source/feed/index.html
index a971588..42cd1c0 100644
--- a/tag/open-source/feed/index.html
+++ b/tag/open-source/feed/index.html
@@ -18,7 +18,7 @@
<sy:updateFrequency>1</sy:updateFrequency>
<item>
- <title>Apache Spot: Three Most-Asked Questions</title>
+ <title>Apache Spot (Incubating): Three Most-Asked Questions</title>
<link>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/</link>
<comments>http://spot.incubator.apache.org/open-network-insight-3-most-asked-questions/#respond</comments>
<pubDate>Tue, 29 Mar 2016 05:48:19 +0000</pubDate>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index aae3a92..8cb018f 100644
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -126,24 +126,6 @@
<script type='text/javascript' src='../../wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
<link rel='https://api.w.org/' href='../../wp-json/' />
- <script>
- (function(i, s, o, g, r, a, m) {
- i['GoogleAnalyticsObject'] = r;
- i[r] = i[r] ||
- function() {
- (i[r].q = i[r].q || []).push(arguments)
- }, i[r].l = 1 * new Date();
- a = s.createElement(o),
- m = s.getElementsByTagName(o)[0];
- a.async = 1;
- a.src = g;
- m.parentNode.insertBefore(a, m)
- })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga');
-
- ga('create', 'UA-75955621-1', 'auto');
- ga('send', 'pageview');
-
- </script>
</head>
<body class="archive tag tag-open-source tag-5" itemscope itemtype="http://schema.org/WebPage">
@@ -161,16 +143,16 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot#contributing-to-oni">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/apache-spot/wiki">Wiki</a>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page current_page_parent menu-item-13">
<a href="../../blog/">Blog</a>
@@ -192,11 +174,11 @@
<h1 class="page-title">Tag: open source</h1>
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
<header class="entry-header article-header">
- <h3 class="h2 entry-title"><a href="../../open-network-insight-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot: Three Most-Asked Questions</a></h3>
+ <h3 class="h2 entry-title"><a href="../../apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
<p class="byline entry-meta vcard">
<time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
March 29, 2016
@@ -209,7 +191,7 @@
<section class="entry-content cf">
<p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../open-network-insight-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more & [...]
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
</p>
</section>
@@ -228,13 +210,16 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
- <a href="../../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../../how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../../open-network-insight-3-most-asked-questions/">Apache Spot: Three Most-Asked Questions</a>
+ <a href="../../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -242,6 +227,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
<a href='../../2016/08/'>August 2016</a>
</li>
<li>
diff --git a/wp-content/themes/oni/favicon.ico b/wp-content/themes/oni/favicon.ico
new file mode 100644
index 0000000..b04db3c
Binary files /dev/null and b/wp-content/themes/oni/favicon.ico differ
diff --git a/wp-content/themes/oni/favicon.png b/wp-content/themes/oni/favicon.png
index e68d33b..1e360dd 100644
Binary files a/wp-content/themes/oni/favicon.png and b/wp-content/themes/oni/favicon.png differ
diff --git a/wp-content/themes/oni/library/css/style.css b/wp-content/themes/oni/library/css/style.css
index 92851fd..b8dd11e 100644
--- a/wp-content/themes/oni/library/css/style.css
+++ b/wp-content/themes/oni/library/css/style.css
@@ -739,6 +739,8 @@ POSTS & CONTENT STYLES
.social-icons a {font-size:2em;}
.social-icons a:hover {color:#fff;}
.social-icons a:first-child {margin-right:15px;}
+.add-to-slack {margin:0 0 0 15px;}
+.add-to-slack {position:relative;top:5px;}
#content { margin-top: 2em; }
diff --git a/wp-content/themes/oni/library/images/add-to-slack.png b/wp-content/themes/oni/library/images/add-to-slack.png
new file mode 100644
index 0000000..93649ed
Binary files /dev/null and b/wp-content/themes/oni/library/images/add-to-slack.png differ
diff --git a/wp-content/themes/oni/library/images/apple-touch-icon.png b/wp-content/themes/oni/library/images/apple-touch-icon.png
index 6c9b524..b561378 100644
Binary files a/wp-content/themes/oni/library/images/apple-touch-icon.png and b/wp-content/themes/oni/library/images/apple-touch-icon.png differ
diff --git a/wp-content/themes/oni/library/images/win8-tile-icon.png b/wp-content/themes/oni/library/images/win8-tile-icon.png
new file mode 100644
index 0000000..2392bed
Binary files /dev/null and b/wp-content/themes/oni/library/images/win8-tile-icon.png differ
diff --git a/wp-content/uploads/2016/03/advantages-1.png b/wp-content/uploads/2016/03/advantages-1.png
index 2487375..e266dfa 100644
Binary files a/wp-content/uploads/2016/03/advantages-1.png and b/wp-content/uploads/2016/03/advantages-1.png differ
diff --git a/wp-content/uploads/2016/03/how-it-works.png b/wp-content/uploads/2016/03/how-it-works.png
index 14c5ced..798ac8f 100644
Binary files a/wp-content/uploads/2016/03/how-it-works.png and b/wp-content/uploads/2016/03/how-it-works.png differ
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png
index edb900a..4034c7d 100644
Binary files a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png and b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png differ
diff --git a/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png b/wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4_old.png
similarity index 100%
copy from wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4.png
copy to wp-content/uploads/2016/09/ONI_Architecture-Diagram_1300_v4_old.png
diff --git a/wp-content/uploads/2016/10/iPython-1-300x89.png b/wp-content/uploads/2016/10/iPython-1-300x89.png
new file mode 100644
index 0000000..a17760c
Binary files /dev/null and b/wp-content/uploads/2016/10/iPython-1-300x89.png differ
diff --git a/wp-content/uploads/2016/10/iPython-1.png b/wp-content/uploads/2016/10/iPython-1.png
new file mode 100644
index 0000000..80b8ea7
Binary files /dev/null and b/wp-content/uploads/2016/10/iPython-1.png differ
[incubator-spot] 18/45: Replacing PHP index files with regular HTML
due compatibility of extension on ASF
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 7bb4a30158479db2c1bad819b5bbf3e755808cea
Author: Cesar <ce...@apache.org>
AuthorDate: Wed Jan 18 01:18:50 2017 -0600
Replacing PHP index files with regular HTML due compatibility of extension on ASF
---
.DS_Store | Bin 10244 -> 10244 bytes
2016/03/index.html | 211 +++++
2016/03/index.php | 60 --
2016/08/index.html | 239 ++++++
2016/08/index.php | 88 ---
2016/09/index.html | 208 +++++
2016/09/index.php | 57 --
2016/10/index.html | 210 +++++
2016/10/index.php | 60 --
tag/index.php => 2016/index.html | 0
blog/apache-spot-3-most-asked-questions/index.html | 245 ++++++
blog/apache-spot-3-most-asked-questions/index.php | 94 ---
.../index.html | 250 ++++++
.../index.php | 98 ---
.../index.html | 232 ++++++
.../index.php | 80 --
blog/{index.php => index.html} | 175 ++++-
.../{index.php => index.html} | 176 ++++-
.../index.html | 221 ++++++
.../index.php | 69 --
category/cybersecurity/index.html | 210 +++++
category/cybersecurity/index.php | 59 --
category/data-science/index.html | 211 +++++
category/data-science/index.php | 59 --
.../index.php => category/index.html | 0
category/ipython-notebooks/index.html | 209 +++++
category/ipython-notebooks/index.php | 56 --
category/security-analytics/index.html | 210 +++++
category/security-analytics/index.php | 58 --
category/threat-analysis-tools/index.html | 210 +++++
category/threat-analysis-tools/index.php | 58 --
category/uncategorized/index.html | 237 ++++++
category/uncategorized/index.php | 85 --
contribute/index.html | 224 ++++++
contribute/index.php | 86 --
doc/index.html | 16 +-
index.html | 867 ++++++++++-----------
index.php | 283 -------
.../index.php => project-components/index.html | 0
project-components/ingestion/index.html | 205 +++++
project-components/ingestion/index.php | 67 --
project-components/machine-learning/index.html | 183 +++++
project-components/machine-learning/index.php | 47 --
project-components/open-data-models/index.html | 188 +++++
project-components/open-data-models/index.php | 60 --
project-components/visualization/index.html | 204 +++++
project-components/visualization/index.php | 79 --
tag/github/index.html | 211 +++++
tag/github/index.php | 57 --
2016/index.php => tag/index.html | 0
tag/open-network-insight/index.html | 211 +++++
tag/open-network-insight/index.php | 59 --
tag/open-source/index.html | 211 +++++
tag/open-source/index.php | 59 --
54 files changed, 5493 insertions(+), 2259 deletions(-)
diff --git a/.DS_Store b/.DS_Store
index e14de31..8dcc55c 100644
Binary files a/.DS_Store and b/.DS_Store differ
diff --git a/2016/03/index.html b/2016/03/index.html
new file mode 100755
index 0000000..fb685ff
--- /dev/null
+++ b/2016/03/index.html
@@ -0,0 +1,211 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>March 2016 - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive date">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: March 2016</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/2016/03/index.php b/2016/03/index.php
deleted file mode 100755
index 943d6c9..0000000
--- a/2016/03/index.php
+++ /dev/null
@@ -1,60 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-
-<?php
-$bodyclass = "archive date";
-$pageTitle = "March 2016 - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: March 2016</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
-
- </body>
-
-</html>
\ No newline at end of file
diff --git a/2016/08/index.html b/2016/08/index.html
new file mode 100755
index 0000000..32a8afb
--- /dev/null
+++ b/2016/08/index.html
@@ -0,0 +1,239 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>August 2016 - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive date">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: August 2016</h1>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-thre [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../blog/how-apache-spot-helps-create-well-stocke [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/2016/08/index.php b/2016/08/index.php
deleted file mode 100755
index f3fd605..0000000
--- a/2016/08/index.php
+++ /dev/null
@@ -1,88 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-
-<?php
-$bodyclass = "archive date";
-$pageTitle = "August 2016 - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: August 2016</h1>
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-thre [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../blog/how-apache-spot-helps-create-well-stocke [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/2016/09/index.html b/2016/09/index.html
new file mode 100755
index 0000000..8c55c1e
--- /dev/null
+++ b/2016/09/index.html
@@ -0,0 +1,208 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>September 2016 - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive date">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: September 2016</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read mor [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/2016/09/index.php b/2016/09/index.php
deleted file mode 100755
index 5ec7cb5..0000000
--- a/2016/09/index.php
+++ /dev/null
@@ -1,57 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-
-<?php
-$bodyclass = "archive date";
-$pageTitle = "September 2016 - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: September 2016</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot needs to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read mor [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
\ No newline at end of file
diff --git a/2016/10/index.html b/2016/10/index.html
new file mode 100755
index 0000000..d10d2d5
--- /dev/null
+++ b/2016/10/index.html
@@ -0,0 +1,210 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>October 2016 - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive date">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Month: October 2016</h1>
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../blog/strength-in-numbers-why-consider-open-source-cy [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/2016/10/index.php b/2016/10/index.php
deleted file mode 100755
index 27ce039..0000000
--- a/2016/10/index.php
+++ /dev/null
@@ -1,60 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-
-<?php
-$bodyclass = "archive date";
-$pageTitle = "October 2016 - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Month: October 2016</h1>
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../blog/strength-in-numbers-why-consider-open-source-cy [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/tag/index.php b/2016/index.html
similarity index 100%
rename from tag/index.php
rename to 2016/index.html
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
new file mode 100755
index 0000000..fd2e424
--- /dev/null
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -0,0 +1,245 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot (Incubating): Three Most-Asked Questions - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating): Three Most-Asked Questions</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.
+ </p>
+ <p>
+ <strong>What Is Apache Spot?</strong>
+ <br />
+ Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security [...]
+ </p>
+ <p>
+ We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an [...]
+ <br />
+ <a href="../../library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="../../library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a>
+ </p>
+ <p>
+ The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.
+ </p>
+ <p>
+ <strong>Why Intel?</strong>
+ </p>
+ <p>
+ At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some prett [...]
+ </p>
+ <p>
+ <strong>Why Open Source?</strong>
+ </p>
+ <p>
+ I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.
+ </p>
+ <p>
+ The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuo [...]
+ </p>
+ <p>
+ Fork us on Github!
+ </p>
+ <p>
+ Grant Babb
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/security-analytics/" rel="category tag">Security Analytics</a>
+ <p class="tags">
+ <span class="tags-title">Tags:</span><a href="../../tag/github/" rel="tag">github</a>, <a href="../../tag/open-network-insight/" rel="tag">open network insight</a>, <a href="../../tag/open-source/" rel="tag">open source</a>
+ </p>
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/blog/apache-spot-3-most-asked-questions/index.php b/blog/apache-spot-3-most-asked-questions/index.php
deleted file mode 100755
index f09a92e..0000000
--- a/blog/apache-spot-3-most-asked-questions/index.php
+++ /dev/null
@@ -1,94 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "single single-post";
-$pageTitle = "Apache Spot (Incubating): Three Most-Asked Questions - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-open-network-insight tag-open-source" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
-
- <header class="article-header entry-header">
-
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating): Three Most-Asked Questions</h1>
-
- <p class="byline entry-meta vcard">
-
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
- <section class="entry-content cf" itemprop="articleBody">
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that effort, came Apache Spot. Since we started talking about the project, these are the three questions I am asked the most.
- </p>
- <p>
- <strong>What Is Apache Spot?</strong>
- <br />
- Apache Spot is an open source, flow and packet analytics solution built on Hadoop. It combines big data processing, at-scale machine learning, and unique security analytics to put potential threats in front of defenders. While I am a data scientist today, I was a security investigator just a few years ago. I wanted to develop a solution that would put new tools and technology in play for defenders, but without requiring them to walk away from security [...]
- </p>
- <p>
- We wanted to start with the hard problems, so we looked at the emerging need to analyze data that was produced at a scale outside what a lot of security solutions could handle. The data is being created today, and lack of visibility into that data gives attackers a profound advantage. Also, in this new era of security, many defenders (public and private sector) have to answer to their citizens and customers when these threats occur. In other words, an [...]
- <br />
- <a href="<?php echo BASE_URL; ?>/library/images/FloCon2015.png" rel="attachment wp-att-66"><img class="aligncenter size-full wp-image-66" src="<?php echo BASE_URL; ?>/library/images/FloCon2015.png" alt="open source packet and flow analytics" /></a>
- </p>
- <p>
- The gist is that while processing is a challenge at higher scales, the amount of insight gained is higher when analyzing flows and packets from key protocols (like DNS). And that’s how we got here.
- </p>
- <p>
- <strong>Why Intel?</strong>
- </p>
- <p>
- At Intel, I have worked in IT, for a security product company (McAfee), and in the Data Center Group. Intel IT was an early pioneer of the concept of proactive investigations to protect intellectual property. McAfee (now Intel Security Group) has a broad customer base in the realms of network, endpoint, and content security, to name only a few. And the Intel Data Center group has strategic partnerships with Cloudera and Accenture, as well as some prett [...]
- </p>
- <p>
- <strong>Why Open Source?</strong>
- </p>
- <p>
- I learned from my earlier efforts in security analytics, that to invite collaboration from academia, the public sector, and the private sector, open source software is an excellent choice. We are now seeking to build a community of developers, data scientists, and security enthusiasts to grow Apache Spot into something we can all be proud of. We have also chosen an Apache software license, so that it can enrich commercial software offerings as well.
- </p>
- <p>
- The greatest thing for me since we announced at RSA is to hear OTHER people talk about Apache Spot (formerly Open Network Insight or ONI), here are some of my favorites, from <a href="http://vision.cloudera.com/open-network-insight-changing-infosec-data-science-forever/" target="_blank">a Data Scientist @ eBay </a>, <a href="https://newsroom.accenture.com/news/accenture-introduces-the-accenture-cyber-intelligence-platform-to-help-organizations-continuo [...]
- </p>
- <p>
- Fork us on Github!
- </p>
- <p>
- Grant Babb
- </p>
- </section>
- <footer class="article-footer">
-
- filed under: <a href="../../category/security-analytics/" rel="category tag">Security Analytics</a>
- <p class="tags">
- <span class="tags-title">Tags:</span><a href="../../tag/github/" rel="tag">github</a>, <a href="../../tag/open-network-insight/" rel="tag">open network insight</a>, <a href="../../tag/open-source/" rel="tag">open source</a>
- </p>
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
new file mode 100755
index 0000000..8eafd08
--- /dev/null
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -0,0 +1,250 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each attack?
+ </p>
+ <p>
+ Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:
+ </p>
+ <ol>
+ <li>
+ Collect information from each device that is part of the environment.
+ </li>
+ <li>
+ Collect information from the critical infrastructure that is used for most, if not all, of the systems.
+ </li>
+ </ol>
+ <p>
+ This blog will describe the second approach.
+ </p>
+ <p>
+ Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or serv [...]
+ </p>
+ <p>
+ Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.
+ </p>
+ <p>
+ Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?
+ </p>
+ <p>
+ First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
+ </p>
+ <p>
+ Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
+ </p>
+ <p>
+ Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
+ </p>
+ <p>
+ <strong>But Wait, There’s More</strong>
+ </p>
+ <p>
+ Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
+ </p>
+ <p>
+ This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/cybersecurity/" rel="category tag">Cybersecurity</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.php b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.php
deleted file mode 100755
index d32442d..0000000
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.php
+++ /dev/null
@@ -1,98 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "single single-post";
-$pageTitle = "Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
-
- <header class="article-header entry-header">
-
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</h1>
-
- <p class="byline entry-meta vcard">
-
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
- <section class="entry-content cf" itemprop="articleBody">
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls along with APTs such as Aurora, Zeus, Red October and Stuxnet. What happened with our security controls on each attack?
- </p>
- <p>
- Despite heroic efforts, internal and external security controls, no matter if they are preventive, detective or corrective, can be bypassed by different situations or misconfigurations. Capabilities to detect bugs or vulnerabilities in code, protocol, etc. are still limited. When we consider how to close these gaps, we have two options:
- </p>
- <ol>
- <li>
- Collect information from each device that is part of the environment.
- </li>
- <li>
- Collect information from the critical infrastructure that is used for most, if not all, of the systems.
- </li>
- </ol>
- <p>
- This blog will describe the second approach.
- </p>
- <p>
- Critical infrastructure, including nationally significant infrastructure, can be broadly defined as the systems, assets, facilities and networks that provide essential services. For nations, this means protecting the national security, economic security and prosperity as well as the health and safety of their citizenry. If we extrapolate this definition on the IT enterprise environments, we can define the critical infrastructure as the service, or serv [...]
- </p>
- <p>
- Effectively protecting critical infrastructure means that millions, if not billions, of different scenarios must be identified and monitored. To do this, the cybersecurity problem must be broken into small pieces.
- </p>
- <p>
- Let’s consider DNS — your communications to the Web. How can you know which communications are being established by your critical servers? And, what if you want to do it for most of your infrastructure?
- </p>
- <p>
- First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
- </p>
- <p>
- Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
- </p>
- <p>
- Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
- </p>
- <p>
- <strong>But Wait, There’s More</strong>
- </p>
- <p>
- Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
- </p>
- <p>
- This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
- </p>
- </section>
- <footer class="article-footer">
-
- filed under: <a href="../../category/cybersecurity/" rel="category tag">Cybersecurity</a>
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
new file mode 100755
index 0000000..79a8523
--- /dev/null
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -0,0 +1,232 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
+ </p>
+ <p>
+ Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
+ </p>
+ <a href="../../library/images/ONI_Architecture-Diagram_1300_v4.png"><img src="../../library/images/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" /></a>
+ <h3><strong>Apache Spot Core Components</strong></h3>
+ <p>
+ The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
+ </p>
+ <p>
+ In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
+ </p>
+ <h3><strong>Operational Analytics</strong></h3>
+ <p>
+ As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
+ </p>
+ <h3><strong>Visualizing Results</strong></h3>
+ <p>
+ The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
+ </p>
+ <h3><strong>Customizable Open Source</strong></h3>
+ <p>
+ Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/uncategorized/" rel="category tag">Uncategorized</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.php b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.php
deleted file mode 100755
index 571915c..0000000
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.php
+++ /dev/null
@@ -1,80 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "single single-post";
-$pageTitle = "How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
-
- <header class="article-header entry-header">
-
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</h1>
-
- <p class="byline entry-meta vcard">
-
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
- <section class="entry-content cf" itemprop="articleBody">
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services company can more accurately determine what other products to offer a customer, and in what or [...]
- </p>
- <p>
- Apache Spot can help to solve most of these issues. Following is a description of the Apache Spot, which is designed to facilitate Big Data analytics scenarios like the financial services company’s question about the right product to offer customers.
- </p>
- <a href="<?php echo BASE_URL; ?>/library/images/ONI_Architecture-Diagram_1300_v4.png"><img src="<?php echo BASE_URL; ?>/library/images/ONI_Architecture-Diagram_1300_v4.png" alt="oni_architecture-diagram_1300_v4" /></a>
- <h3><strong>Apache Spot Core Components</strong></h3>
- <p>
- The Apache Spot Core is composed of three main components — data integration (collectors), data store (HDFS here, but can also be a non-SQL database) and machine learning.
- </p>
- <p>
- In this diagram, the top left shows Apache Spot Data Sources, which include the collection of the information that will be used to create a data lake. The process is simple. Define a pull or push from the source of information then capture this information on Apache Spot’s “collectors.” The collectors are processes that interpret the information that is sent, then write it to the HDFS system in the Apache Spot cluster. The HDFS stores the data lake and [...]
- </p>
- <h3><strong>Operational Analytics</strong></h3>
- <p>
- As part of operational analytics, Apache Spot executes different batch processes that add information to machine learning results to provide meaning and context. Using the financial services product example, basic customer data could be augmented with information about other customers in the same region along with information about which products those customers recommended or complained about. Basically, the data scientists can “play” with the data us [...]
- </p>
- <h3><strong>Visualizing Results</strong></h3>
- <p>
- The Apache Spot GUI displays the results that the machine learning algorithms generate. Results are represented such that it is easy to identify both the most common things as well as find the most suspicious or uncommon information that is part of the data lake.
- </p>
- <h3><strong>Customizable Open Source</strong></h3>
- <p>
- Because Apache Spot is an open-source project, most of the components depicted here can be modified by the end user.
- </p>
- </section>
- <footer class="article-footer">
-
- filed under: <a href="../../category/uncategorized/" rel="category tag">Uncategorized</a>
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/blog/index.php b/blog/index.html
similarity index 54%
rename from blog/index.php
rename to blog/index.html
index 4537ac3..b875c52 100755
--- a/blog/index.php
+++ b/blog/index.html
@@ -1,11 +1,109 @@
-<?php include '../includes/config.php'; ?>
-<?php
-$bodyclass = "blog";
-$pageTitle = "Apache Spot Blog";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../includes/header.php'; ?>
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot Blog</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="blog">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="http://spot.incubator.apache.org/doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
<div id="content">
@@ -139,15 +237,68 @@ $currentPage = 'blog';
</main>
- <?php include '../includes/sidebar.php'; ?>
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
</div>
</div>
-
- <?php include '../includes/footer.php'; ?>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../library/js/scripts.js'></script>
</body>
</html>
-<!-- end of site. what a ride! -->
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.php b/blog/jupyter-notebooks-for-data-analysis/index.html
similarity index 55%
rename from blog/jupyter-notebooks-for-data-analysis/index.php
rename to blog/jupyter-notebooks-for-data-analysis/index.html
index 1931779..d750307 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.php
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -1,11 +1,109 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "single single-post";
-$pageTitle = "Jupyter Notebooks for Data Analysis - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Jupyter Notebooks for Data Analysis - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
<div id="content">
@@ -41,7 +139,7 @@ $currentPage = 'blog';
<p>
Starting on version 4.0, most notebook functionalities are now part of the Project Jupyter, while iPython remains as the kernel to work with Python code in the notebooks.
</p>
- <img src="<?php echo BASE_URL;?>/library/images/iPython-1.png" alt="ipython" class="aligncenter size-full wp-image-140" />
+ <img src="../../library/images/iPython-1.png" alt="ipython" class="aligncenter size-full wp-image-140" />
<p>
<strong>IPython with Apache Spot for Network Threat Detection</strong>
</p>
@@ -114,15 +212,69 @@ $currentPage = 'blog';
</main>
- <?php include '../../includes/sidebar.php'; ?>
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
</div>
</div>
- <?php include '../../includes/footer.php'; ?>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
</body>
</html>
-<!-- end of site. what a ride! -->
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
new file mode 100755
index 0000000..7aef5e4
--- /dev/null
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -0,0 +1,221 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Strength in Numbers: Why Consider Open Source Cybersecurity Analytics - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="single single-post">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
+
+ <header class="article-header entry-header">
+
+ <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</h1>
+
+ <p class="byline entry-meta vcard">
+
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+ <section class="entry-content cf" itemprop="articleBody">
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics
+ </p>
+ <p>
+ Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on com [...]
+ </p>
+ <p>
+ This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often look [...]
+ </p>
+ <p>
+ By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve t [...]
+ </p>
+ <p>
+ By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leve [...]
+ </p>
+ </section>
+ <footer class="article-footer">
+
+ filed under: <a href="../../category/uncategorized/" rel="category tag">Uncategorized</a>
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.php b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.php
deleted file mode 100755
index c86b518..0000000
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.php
+++ /dev/null
@@ -1,69 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "single single-post";
-$pageTitle = "Strength in Numbers: Why Consider Open Source Cybersecurity Analytics - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article" itemscope itemprop="blogPost" itemtype="http://schema.org/BlogPosting">
-
- <header class="article-header entry-header">
-
- <h1 class="entry-title single-title" itemprop="headline" rel="bookmark">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</h1>
-
- <p class="byline entry-meta vcard">
-
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
- <section class="entry-content cf" itemprop="articleBody">
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics
- </p>
- <p>
- Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology. The problem is, with so much competition, are we losing sight of the real goal: protecting our customers against the adversary? With so much focus on com [...]
- </p>
- <p>
- This, of course, is not new information. People have been pointing this out for years. What is encouraging is that a few organizations are finally stepping up to the plate to try and change this paradigm in cybersecurity. When it comes to cybersecurity, many have touted big data analytics as one of the key initiatives to combat adversaries. The problem is that big data in itself has its own set of challenges, one of the issues is that it is often look [...]
- </p>
- <p>
- By creating an open source community, the hope is that identifying security threats within large data sets will become a manageable task for all organizations, despite their size or scale. Organizations overwhelmed with their data or those that aren’t seeing results will have a community to turn to along with a common reference to compare results. By working together on Apache Spot, organizations will be able to share their experiences on how they’ve t [...]
- </p>
- <p>
- By supporting Apache Spot, Cybraics is hoping to learn as much as we contribute while we collaborate and take part in this Open Source Initiative. With the end result a set of guidelines for organizations to deploy a data analytics platform to find threats within their ecosystem, and a community that will share their experiences with the next generation of data and security professionals, perhaps we can all start actually working together to start leve [...]
- </p>
- </section>
- <footer class="article-footer">
-
- filed under: <a href="../../category/uncategorized/" rel="category tag">Uncategorized</a>
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
new file mode 100755
index 0000000..60493e9
--- /dev/null
+++ b/category/cybersecurity/index.html
@@ -0,0 +1,210 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Cybersecurity - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Cybersecurity</h1>
+
+ <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-thre [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/category/cybersecurity/index.php b/category/cybersecurity/index.php
deleted file mode 100755
index 1021e91..0000000
--- a/category/cybersecurity/index.php
+++ /dev/null
@@ -1,59 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive category";
-$pageTitle = "Cybersecurity - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Cybersecurity</h1>
-
- <article id="post-117" class="cf post-117 post type-post status-publish format-standard hentry category-cybersecurity" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/" rel="bookmark" title="Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- The “first” documented cybersecurity case was the worm replication, which was initiated by Robert T. Morris on November 2, 1988. Wow! Here we are in 2016, 28 years later, with viruses and worms giving way to Trojan horses and polymorphic code. Nowadays, we are also fighting against DDoS, phishing, spear phishing attacks, command and controls… <a class="excerpt-read-more" href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-thre [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php';?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php';?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/data-science/index.html b/category/data-science/index.html
new file mode 100755
index 0000000..4aea8b4
--- /dev/null
+++ b/category/data-science/index.html
@@ -0,0 +1,211 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Data Science - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Data Science</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/category/data-science/index.php b/category/data-science/index.php
deleted file mode 100755
index 5d57edb..0000000
--- a/category/data-science/index.php
+++ /dev/null
@@ -1,59 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive category";
-$pageTitle = "Data Science - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Data Science</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/project-components/index.php b/category/index.html
similarity index 100%
rename from project-components/index.php
rename to category/index.html
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
new file mode 100755
index 0000000..193c5f1
--- /dev/null
+++ b/category/ipython-notebooks/index.html
@@ -0,0 +1,209 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Ipython Notebooks - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Ipython Notebooks</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/category/ipython-notebooks/index.php b/category/ipython-notebooks/index.php
deleted file mode 100755
index 008751f..0000000
--- a/category/ipython-notebooks/index.php
+++ /dev/null
@@ -1,56 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive category";
-$pageTitle = "Ipython Notebooks - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Ipython Notebooks</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php';?>
-
- </body>
-
-</html>
\ No newline at end of file
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
new file mode 100755
index 0000000..d673813
--- /dev/null
+++ b/category/security-analytics/index.html
@@ -0,0 +1,210 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Security Analytics - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Security Analytics</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/category/security-analytics/index.php b/category/security-analytics/index.php
deleted file mode 100755
index fc4d27a..0000000
--- a/category/security-analytics/index.php
+++ /dev/null
@@ -1,58 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive category";
-$pageTitle = "Security Analytics - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Security Analytics</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php';?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php';?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
new file mode 100755
index 0000000..d21b80c
--- /dev/null
+++ b/category/threat-analysis-tools/index.html
@@ -0,0 +1,210 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>hreat Analysis Tools - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Threat Analysis Tools</h1>
+
+ <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
+ September 22, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
diff --git a/category/threat-analysis-tools/index.php b/category/threat-analysis-tools/index.php
deleted file mode 100755
index 738d0ff..0000000
--- a/category/threat-analysis-tools/index.php
+++ /dev/null
@@ -1,58 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive category";
-$pageTitle = "Threat Analysis Tools - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Threat Analysis Tools</h1>
-
- <article id="post-136" class="cf post-136 post type-post status-publish format-standard hentry category-data-science category-ipython-notebooks category-threat-analysis-tools" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/jupyter-notebooks-for-data-analysis/" rel="bookmark" title="Jupyter Notebooks for Data Analysis">Jupyter Notebooks for Data Analysis</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-09-22" itemprop="datePublished">
- September 22, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- Why Does Apache Spot Include iPython notebooks? The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython… <a class="excerpt-read-more" href="../../blog/jupyter-notebooks-for-data-analysis/" title="Read Jupyter Notebooks for Data Analysis">Read m [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
new file mode 100755
index 0000000..b2a13a5
--- /dev/null
+++ b/category/uncategorized/index.html
@@ -0,0 +1,237 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Uncategorized - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Category: Uncategorized</h1>
+
+ <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
+ October 21, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../blog/strength-in-numbers-why-consider-open-source-cy [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
+ August 8, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../blog/how-apache-spot-helps-create-well-stocke [...]
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/category/uncategorized/index.php b/category/uncategorized/index.php
deleted file mode 100755
index a727d75..0000000
--- a/category/uncategorized/index.php
+++ /dev/null
@@ -1,85 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive category";
-$pageTitle = "Uncategorized - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Category: Uncategorized</h1>
-
- <article id="post-149" class="cf post-149 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/" rel="bookmark" title="Strength in Numbers: Why Consider Open Source Cybersecurity Analytics">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-10-21" itemprop="datePublished">
- October 21, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- By Rob Kent, Vice President of Marketing at Cybraics Competition is widely considered to be a healthy and positive thing, traditionally viewed as providing options for customers and fueling innovation. In the world of cybersecurity there is no shortage of competition, in fact cybersecurity is one of the most crowded and fast-growing areas of technology…. <a class="excerpt-read-more" href="../../blog/strength-in-numbers-why-consider-open-source-cy [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- <article id="post-113" class="cf post-113 post type-post status-publish format-standard hentry category-uncategorized" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/" rel="bookmark" title="How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-08-08" itemprop="datePublished">
- August 8, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- About four years ago, the era of the Big Data analytics began. Paired with advanced analytics, massive volumes of data can be culled to not only inform critical decisions, but also to simulate sophisticated “what if” scenarios that allow companies to gain competitive advantages by generating and predicting different scenarios. For example, a financial services… <a class="excerpt-read-more" href="../../blog/how-apache-spot-helps-create-well-stocke [...]
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/contribute/index.html b/contribute/index.html
new file mode 100755
index 0000000..ee0cdaa
--- /dev/null
+++ b/contribute/index.html
@@ -0,0 +1,224 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Contribute - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
+ <a href="../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Proposed Apache-Spot (incubating) Commit Workflow</h1>
+
+ <p><strong>NOTE: Most of this guide is based on ASF Documentation.</strong></p>
+
+ <p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.</p>
+
+ <p>Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
+
+ <h3 class="center" style="margin-top:35px;">Individual Push (most commonly used by the community):</h3>
+
+ <p><img src="../library/images/individual-push.png" alt="" /></p>
+
+ <p><strong>Steps:</strong></p>
+
+ <ol>
+ <li>For the Github repository at <a href="https://github.com/apache/incubator-spot" target="_blank">https://github.com/apache/incubator-spot</a> if you haven't already. For more information about Fork please go to: <a href="https://help.github.com/articles/fork-a-repo/" target="_blank">https://help.github.com/articles/fork-a-repo/</a></li>
+ <li>Clone your fork, create a new branch named after a Jira issue (i.e. <strong>spot-100</strong>).</li>
+ <li>Push commits to your local branch.</li>
+ <li>Test it!!!</li>
+ <li>Create a pull request (PR) against the upstream repo (master) of apache-spot. For more information about how to create a pull request please go to: <a href="https://help.github.com/articles/about-pull-requests/" target="_blank">https://help.github.com/articles/about-pull-requests/</a>.</li>
+ <li>Wait for the maintainers to review your PR.</li>
+ </ol>
+
+ <h3 class="center" style="margin-top:35px;">Topic Branching (upstream)</h3>
+
+ <p>What are a topic branches?</p>
+
+ <blockquote>According to the git definition: "<em>A topic branch is a short-lived branch that you create and use for a single particular feature or related work.</em>" (<a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches</a>)</blockquote>
+
+ <p>Sometimes a new major feature will have dependencies between modules or developers that can't be separated into individual pushes, when this happens, a topic branch will be created to deliver the complete functionality before the merge with the upstream (encapsulated dev enviroment).</p>
+
+ <p>In order to create a topic branch, three requirements are needed:</p>
+
+ <ol>
+ <li>A design document must be uploaded using Jira. This design must be approved by the maintainers.</li>
+ <li>A voting process will be required to approve the topic branch creation, at least 3 maintainers need to approve it.</li>
+ <li>A commitment to delete the branch after merging it into the upstream branch must be done. The topic branch should only exist while the work is still in progress.</li>
+ </ol>
+
+ <p>A meaningful name must be given to the branch. It is recommended to use JIRA issue created with the design document to link the branch.</p>
+
+ <p><img src="../library/images/topic-branching.png" alt="" /></p>
+
+ <p><strong>IMPORTANT: There shouldn't be a push without a Jira created previously</strong></p>
+
+ <h3>Approvals and Voting Process:</h3>
+
+ <blockquote>
+ <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
+
+ <p>Unless a vote has been declared as using <u>lazy consensus</u>, three +1 votes are required for a code-modification proposal to pass.</p>
+
+ <p>Whole numbers are recommended for this type of vote, as the opinion being expressed is Boolean: 'I approve/do not approve of this change.'</p>
+
+ <p><strong>Source: <a href="http://apache.org/foundation/voting.html" target="_blank">http://apache.org/foundation/voting.html</a></strong></p>
+ </blockquote>
+
+ <h3>Useful links:</h3>
+
+ <ul>
+ <li><a href="https://www.apache.org/foundation/glossary.html" target="_blank">https://www.apache.org/foundation/glossary.html</a></li>
+ <li><a href="http://www.apache.org/dev/committers" target="_blank">http://www.apache.org/dev/committers</a></li>
+ <li><a href="http://www.apache.org/dev/git.html" target="_blank">http://www.apache.org/dev/git.html</a></li>
+ <li><a href="http://www.apache.org/dev/writable-git" target="_blank">http://www.apache.org/dev/writable-git</a></li>
+ </ul>
+ </div>
+ </div>
+
+ </div>
+
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/contribute/index.php b/contribute/index.php
deleted file mode 100755
index aa92b45..0000000
--- a/contribute/index.php
+++ /dev/null
@@ -1,86 +0,0 @@
-<?php include '../includes/config.php'; ?>
-<?php
-$bodyclass = "page";
-$pageTitle = "Contribute - Apache Spot";
-$description = "";
-$currentPage = 'contribute';
-?>
-<?php include '../includes/header.php'; ?>
-
- <div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Proposed Apache-Spot (incubating) Commit Workflow</h1>
-
- <p><strong>NOTE: Most of this guide is based on ASF Documentation.</strong></p>
-
- <p>This guide is meant to provide a workflow for committers of Apache Spot. The proposed workflow is for using git with apache-spot codebase.</p>
-
- <p>Depending the nature of the change two different approaches can be used to commit to Apache Spot: <strong>Individual Push</strong> or <strong>Topic Branding</strong>.</p>
-
- <h3 class="center" style="margin-top:35px;">Individual Push (most commonly used by the community):</h3>
-
- <p><img src="<?php echo BASE_URL; ?>/library/images/individual-push.png" alt="" /></p>
-
- <p><strong>Steps:</strong></p>
-
- <ol>
- <li>For the Github repository at <a href="https://github.com/apache/incubator-spot" target="_blank">https://github.com/apache/incubator-spot</a> if you haven't already. For more information about Fork please go to: <a href="https://help.github.com/articles/fork-a-repo/" target="_blank">https://help.github.com/articles/fork-a-repo/</a></li>
- <li>Clone your fork, create a new branch named after a Jira issue (i.e. <strong>spot-100</strong>).</li>
- <li>Push commits to your local branch.</li>
- <li>Test it!!!</li>
- <li>Create a pull request (PR) against the upstream repo (master) of apache-spot. For more information about how to create a pull request please go to: <a href="https://help.github.com/articles/about-pull-requests/" target="_blank">https://help.github.com/articles/about-pull-requests/</a>.</li>
- <li>Wait for the maintainers to review your PR.</li>
- </ol>
-
- <h3 class="center" style="margin-top:35px;">Topic Branching (upstream)</h3>
-
- <p>What are a topic branches?</p>
-
- <blockquote>According to the git definition: "<em>A topic branch is a short-lived branch that you create and use for a single particular feature or related work.</em>" (<a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches</a>)</blockquote>
-
- <p>Sometimes a new major feature will have dependencies between modules or developers that can't be separated into individual pushes, when this happens, a topic branch will be created to deliver the complete functionality before the merge with the upstream (encapsulated dev enviroment).</p>
-
- <p>In order to create a topic branch, three requirements are needed:</p>
-
- <ol>
- <li>A design document must be uploaded using Jira. This design must be approved by the maintainers.</li>
- <li>A voting process will be required to approve the topic branch creation, at least 3 maintainers need to approve it.</li>
- <li>A commitment to delete the branch after merging it into the upstream branch must be done. The topic branch should only exist while the work is still in progress.</li>
- </ol>
-
- <p>A meaningful name must be given to the branch. It is recommended to use JIRA issue created with the design document to link the branch.</p>
-
- <p><img src="<?php echo BASE_URL; ?>/library/images/topic-branching.png" alt="" /></p>
-
- <p><strong>IMPORTANT: There shouldn't be a push without a Jira created previously</strong></p>
-
- <h3>Approvals and Voting Process:</h3>
-
- <blockquote>
- <p>For code-modification, +1 votes are in favor of the proposal, but -1 votes are <u>vetos</u> and kill the proposal dead until all vetoers withdraw their -1 votes.</p>
-
- <p>Unless a vote has been declared as using <u>lazy consensus</u>, three +1 votes are required for a code-modification proposal to pass.</p>
-
- <p>Whole numbers are recommended for this type of vote, as the opinion being expressed is Boolean: 'I approve/do not approve of this change.'</p>
-
- <p><strong>Source: <a href="http://apache.org/foundation/voting.html" target="_blank">http://apache.org/foundation/voting.html</a></strong></p>
- </blockquote>
-
- <h3>Useful links:</h3>
-
- <ul>
- <li><a href="https://www.apache.org/foundation/glossary.html" target="_blank">https://www.apache.org/foundation/glossary.html</a></li>
- <li><a href="http://www.apache.org/dev/committers" target="_blank">http://www.apache.org/dev/committers</a></li>
- <li><a href="http://www.apache.org/dev/git.html" target="_blank">http://www.apache.org/dev/git.html</a></li>
- <li><a href="http://www.apache.org/dev/writable-git" target="_blank">http://www.apache.org/dev/writable-git</a></li>
- </ul>
- </div>
- </div>
-
- </div>
-
-
-<?php include '../includes/prefooter.php'; ?>
-<?php include '../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/doc/index.html b/doc/index.html
index 91799f3..c7280f2 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -59,22 +59,22 @@
<a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
</li>
<li class="menu-item">
- <a href="http://spot.incubator.apache.org/contribute">Contribute</a>
+ <a href="../contribute">Contribute</a>
</li>
- <li class="menu-item">
- <a href="http://spot.incubator.apache.org/doc/">Documentation</a>
+ <li class="menu-item active">
+ <a href="../doc/">Documentation</a>
</li>
<li class="menu-item menu-item-has-children">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="http://spot.incubator.apache.org/project-components/open-data-models">Open Data Models</a></li>
- <li><a href="http://spot.incubator.apache.org/project-components/ingestion">Ingestion</a></li>
- <li><a href="http://spot.incubator.apache.org/project-components/machine-learning">Machine Learning</a></li>
- <li><a href="http://spot.incubator.apache.org/project-components/visualization">Visualization</a></li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
</ul>
</li>
<li class="menu-item">
- <a href="http://spot.incubator.apache.org/blog">Blog</a>
+ <a href="../blog">Blog</a>
</li>
</ul>
</nav>
diff --git a/index.html b/index.html
index 3b138ba..cc9d552 100755
--- a/index.html
+++ b/index.html
@@ -1,449 +1,418 @@
-<!doctype html>
-
-<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
-<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
-<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
-<!--[if gt IE 8]><!-->
-<html lang="en-US" class="no-js">
- <!--<![endif]-->
-
- <head>
- <meta charset="utf-8">
-
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
-
- <title>Apache Spot</title>
-
- <meta name="HandheldFriendly" content="True">
- <meta name="MobileOptimized" content="320">
- <meta name="viewport" content="width=device-width, initial-scale=1"/>
-
- <link rel="apple-touch-icon" href="wp-content/themes/oni/library/images/apple-touch-icon.png">
- <link rel="icon" href="wp-content/themes/oni/favicon.png">
- <!--[if IE]>
- <link rel="shortcut icon" href="wp-content/themes/oni/favicon.ico">
- <![endif]-->
- <meta name="msapplication-TileColor" content="#f01d4f">
- <meta name="msapplication-TileImage" content="wp-content/themes/oni/library/images/win8-tile-icon.png">
- <meta name="theme-color" content="#121212">
-
- <link rel="pingback" href="xmlrpc.php">
-
- <link rel='dns-prefetch' href='//fonts.googleapis.com' />
- <link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="comments/feed/" />
- <script type="text/javascript">
- window._wpemojiSettings = {
- "baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
- "ext" : ".png",
- "svgUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/svg\/",
- "svgExt" : ".svg",
- "source" : {
- "concatemoji" : "http:\/\/spot.incubator.apache.org\/wp-includes\/js\/wp-emoji-release.min.js"
- }
- };
- ! function(a, b, c) {
- function d(a) {
- var c,
- d,
- e,
- f,
- g,
- h = b.createElement("canvas"),
- i = h.getContext && h.getContext("2d"),
- j = String.fromCharCode;
- if (!i || !i.fillText)
- return !1;
- switch(i.textBaseline="top",i.font="600 32px Arial",a) {
- case"flag":
- return i.fillText(j(55356, 56806, 55356, 56826), 0, 0), !(h.toDataURL().length < 3e3) && (i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 65039, 8205, 55356, 57096), 0, 0),
- c = h.toDataURL(), i.clearRect(0, 0, h.width, h.height), i.fillText(j(55356, 57331, 55356, 57096), 0, 0),
- d = h.toDataURL(), c !== d);
- case"diversity":
- return i.fillText(j(55356, 57221), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- f = e[0] + "," + e[1] + "," + e[2] + "," + e[3], i.fillText(j(55356, 57221, 55356, 57343), 0, 0),
- e = i.getImageData(16, 16, 1, 1).data,
- g = e[0] + "," + e[1] + "," + e[2] + "," + e[3], f !== g;
- case"simple":
- return i.fillText(j(55357, 56835), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode8":
- return i.fillText(j(55356, 57135), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0];
- case"unicode9":
- return i.fillText(j(55358, 56631), 0, 0), 0 !== i.getImageData(16,16,1,1).data[0]
- }
- return !1
- }
-
- function e(a) {
- var c = b.createElement("script");
- c.src = a, c.type = "text/javascript", b.getElementsByTagName("head")[0].appendChild(c)
- }
-
- var f,
- g,
- h,
- i;
- for ( i = Array("simple", "flag", "unicode8", "diversity", "unicode9"), c.supports = {
- everything : !0,
- everythingExceptFlag : !0
- },
- h = 0; h < i.length; h++)
- c.supports[i[h]] = d(i[h]), c.supports.everything = c.supports.everything && c.supports[i[h]], "flag" !== i[h] && (c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && c.supports[i[h]]);
- c.supports.everythingExceptFlag = c.supports.everythingExceptFlag && !c.supports.flag, c.DOMReady = !1, c.readyCallback = function() {
- c.DOMReady = !0
- }, c.supports.everything || ( g = function() {
- c.readyCallback()
- }, b.addEventListener ? (b.addEventListener("DOMContentLoaded", g, !1), a.addEventListener("load", g, !1)) : (a.attachEvent("onload", g), b.attachEvent("onreadystatechange", function() {
- "complete" === b.readyState && c.readyCallback()
- })),
- f = c.source || {}, f.concatemoji ? e(f.concatemoji) : f.wpemoji && f.twemoji && (e(f.twemoji), e(f.wpemoji)))
- }(window, document, window._wpemojiSettings);
- </script>
- <style type="text/css">
- img.wp-smiley, img.emoji {
- display: inline !important;
- border: none !important;
- box-shadow: none !important;
- height: 1em !important;
- width: 1em !important;
- margin: 0 .07em !important;
- vertical-align: -0.1em !important;
- background: none !important;
- padding: 0 !important;
- }
- </style>
- <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
- <link rel='stylesheet' id='bones-stylesheet-css' href='wp-content/themes/oni/library/css/style.css' type='text/css' media='all' />
- <!--[if lt IE 9]>
- <link rel='stylesheet' id='bones-ie-only-css' href='wp-content/themes/oni/library/css/ie.css' type='text/css' media='all' />
- <![endif]-->
- <link rel='stylesheet' id='mm-css-css' href='wp-content/themes/oni/library/css/meanmenu.css' type='text/css' media='all' />
- <script type='text/javascript' src='wp-content/themes/oni/library/js/libs/modernizr.custom.min.js'></script>
- <script type='text/javascript' src='wp-includes/js/jquery/jquery.js'></script>
- <script type='text/javascript' src='wp-includes/js/jquery/jquery-migrate.min.js'></script>
- <script type='text/javascript' src='wp-content/themes/oni/library/js/jquery.meanmenu.js'></script>
- <link rel='https://api.w.org/' href='wp-json/' />
- <link rel="canonical" href="" />
- <link rel='shortlink' href='' />
- <link rel="alternate" type="application/json+oembed" href="wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2F" />
- <link rel="alternate" type="text/xml+oembed" href="wp-json/oembed/1.0/embed?url=http%3A%2F%2Fnolamarketing.com%2Fclient%2Foni%2F&format=xml" />
-
- </head>
-
- <body class="home page page-id-8 page-template-default" itemscope itemtype="http://schema.org/WebPage">
-
- <div id="container">
-
- <header class="header" role="banner" itemscope itemtype="http://schema.org/WPHeader">
-
- <div id="inner-header" class="wrap cf">
-
- <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
- <a href="http://spot.incubator.apache.org" rel="nofollow"><img src="wp-content/themes/oni/library/images/logo.png" alt="Open Network Insight" /></a>
- </p>
-
- <nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
- <ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
- </li>
- <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
- </li>
- <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
- </li>
- <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
- </li>
- <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
- <a href="blog/">Blog</a>
- </li>
- </ul>
- </nav>
-
- </div>
-
- </header>
-
- <div id="mobile-nav"></div>
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all t-1of2 d-1of2 oni-guy">
- <img src="wp-content/uploads/2016/03/spot470.png" class="oniguy" alt="" />
- </div>
- <div class="m-all t-1of2 d-1of2">
- <h2>Apache Spot (Incubating)
- <br>
- at a Glance</h2>
- <p>
- For organizations with dynamic data centers and networks, Apache Spot is an advanced threat detection solution that uses big data analytics, that perform at cloud scale, to provide actionable insights into operational and security threats. Running on Apache Hadoop, Apache Spot can analyze billions of events in order to detect unknown threats, insider threats, and gain a new level of visibility into the network.
- </p>
- <p class="btn-margin">
- <a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
- </p>
- </div>
- </div>
- </div>
-
- <div id="content">
- <div id="inner-content" class="wrap cf">
- <main id="main" class="m-all t-all d-all cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="center">Apache Spot Advantages</h1>
- <p style="text-align: center;"><img src="wp-content/uploads/2016/03/advantages-1.png" alt="advantages" width="958" height="433" class="aligncenter size-full wp-image-139" srcset="wp-content/uploads/2016/03/advantages-1.png 958w, wp-content/uploads/2016/03/advantages-1-300x136.png 300w, wp-content/uploads/2016/03/advantages-1-768x347.png 768w" sizes="(max-width: 958px) 100vw, 958px" />
- </p>
- </main>
- </div>
- </div>
-
- <div id="and">
- <div class="wrap cf">
- <div class="and-row">
- <div class="and-cell">
- <img src="wp-content/themes/oni/library/images/and.png" alt="" />
- </div>
- <div class="and-cell">
- <p>
- Apache Spot is functional after just one day and just keeps improving through feedback and machine learning.
- </p>
- </div>
- </div>
- </div>
- </div>
-
- <div id="how-it-works">
- <div class="wrap cf">
- <div class="m-all t-1of3 d-1of3">
- <h1>How It Works</h1>
- <p>
- Apache Spot uses machine learning as a filter for separating bad traffic from benign and to characterize the unique behavior of network traffic. A proven process, of context enrichment, noise filtering, whitelisting and heuristics, is also applied to network data to produce a shortlist of most likely security threats.
- </p>
- <p class="btn-margin">
- <a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
- </p>
- </div>
- <div class="m-all t-2of3 d-2of3">
- <img src="wp-content/uploads/2016/03/how-it-works.png" alt="" />
- </div>
- </div>
- </div>
-
- <div id="key-features">
- <div class="wrap cf">
- <h1>Key Features</h1>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="wp-content/uploads/2016/03/magnify-icon.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Suspicious DNS packets</h3>
- </div>
- </div>
- </div>
- <p>
- Apache Spot is capable of performing deep-packet inspection of DNS traffic to build a profile of probable and improbable DNS payloads. After visualizing, normalizing, and conducting pattern searches, the analyst has a shortlist of the most likely threats present in DNS traffic.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="wp-content/uploads/2016/03/threat-icon.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Threat Incident and Response</h3>
- </div>
- </div>
- </div>
- <p>
- Given an IP address, Apache Spot gathers all the characteristics about the communication associated with it – the “social network” of that IP address. Then Apache Spot builds a timeline of the conversations that originated with that IP.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="wp-content/uploads/2016/03/connects.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Suspicious Connects</h3>
- </div>
- </div>
- </div>
- <p>
- Apache Spot uses advanced machine learning to build a model of the machines on the network and their communication patterns. The connections between the machines that are the lowest probability are then visualized, filtered for noise, and searched for known patterns. The result is the most likely threat patterns in the data, a few hundred flows picked from billions.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="wp-content/uploads/2016/03/storyboard-icon.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Storyboard</h3>
- </div>
- </div>
- </div>
- <p>
- After an analyst has investigated a threat, the need still exists to communicate the event up and across the organization. A “dashboard” gives quick answers to the questions you already know to ask. What the analyst requires is a “storyboard,” something that tells who, what, where, and how of the story in words and interactive visualizations.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="wp-content/uploads/2016/03/SPOT_OpenDataModel-Icon_v1.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Open Data Models</h3>
- </div>
- </div>
- </div>
- <p>
- Spot provides common open data model for network, endpoint, and user – Open Data Models. These Open Data Models provide a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="wp-content/uploads/2016/03/SPOT_Collabration-Icon_v2.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Collaboration</h3>
- </div>
- </div>
- </div>
- <p>
- Spot’s Open Data Models help organizations quickly share new analytics with one another as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
- </p>
- </div>
-
- <div class="cf"></div>
- <p class="btn-margin">
- <a href="https://github.com/Open-Network-Insight" class="y-btn">More Info</a>
- </p>
- </div>
- </div>
-
- <div id="user-stories">
- <div class="wrap cf">
- <h1>Spot Fosters a Rich Application Ecosystem</h1>
- <p class="btn-margin center">
- Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
- </p>
-
- </div>
- </div>
-
- <div id="use-case">
- <div class="wrap cf">
-
- <h1>Use Case</h1>
- <div class="quotes">
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
- <h3>Senior Analyst</h3>
- </div>
- <div class="table-cell">
- <p>
- ...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”
- </p>
- </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
- <h3>Junior Analyst</h3>
- </div>
- <div class="table-cell">
- <p>
- ...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
- </p>
- </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="wp-content/themes/oni/library/images/quote-person.png" alt="" />
- <h3>Decision Maker</h3>
- </div>
- <div class="table-cell">
- <p>
- ...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
- </p>
- </div>
- </div>
- </div>
-
- </div>
-
- </div>
-
- <div class="arrow">
- <div class="wrap cf">
- <p>
- Identify the needle in the haystack with <strong>patterns</strong> that provide insight into potential threats.
- </p>
- </div>
- </div>
- </div>
-
- <div id="more-info">
- <div class="wrap cf">
- <p class="social-icons">
- <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="wp-content/themes/oni/library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
- </p>
-
- <p>
- <a href="https://github.com/Open-Network-Insight/open-network-insight" class="y-btn" target="_blank">More Info</a>
- </p>
-
- <p style="margin-top:50px;"><img src="wp-content/themes/oni/library/images/apache-incubator.png" alt="Apache Incubator" />
- </p>
-
- <p class="disclaimer">
- Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
- </p>
-
- <p class="disclaimer">
- The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
- </p>
- </div>
- </div>
-
- <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
-
- <div id="inner-footer" class="wrap cf">
-
- <nav role="navigation"></nav>
- <p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
- </p>
-
- </div>
-
- </footer>
-
- </div>
-
- <script type='text/javascript' src='wp-content/themes/oni/library/js/scripts.js'></script>
- <script type='text/javascript' src='wp-includes/js/wp-embed.min.js'></script>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="library/images/apple-touch-icon.png">
+ <link rel="icon" href="favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='/library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="home">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="project-components/ingestion">Ingestion</a></li>
+ <li><a href="project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all t-1of2 d-1of2">
+ <h1>Apache Spot (Incubating)</h1>
+ <h1 class="thin">A Community Approach to Fighting Cyber Threats</h1>
+ </div>
+ <div class="m-all t-1of2 d-1of2 contribute">
+ <h3>Help Spot expand his hunting ground to see deeper into the darkness of cyber threats.</h3>
+ <p class="btn-margin"><a href="contribute" class="y-btn">Become a Contributor</a></p>
+ </div>
+ </div>
+ </div>
+
+ <div id="at-a-glance">
+ <div class="wrap cf">
+ <h1>Apache Spot at a Glance</h1>
+ <p>Apache Spot is a community-driven cybersecurity project, built from the ground up, to bring advanced analytics to all IT Telemetry data on an open, scalable platform. Spot expedites threat detection, investigation, and remediation via machine learning and consolidates all enterprise security data into a comprehensive IT telemetry hub based on open data models. Spot’s scalability and machine learning capabilities support an ecosystem of ML-based applications that can run [...]
+ </div>
+ </div>
+
+ <div id="content">
+ <div id="inner-content" class="wrap cf">
+ <main id="main" class="m-all t-all d-all cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+ <h1 class="center">Apache Spot Advantages</h1>
+ <p style="text-align: center;"><img src="library/images/advantages-1.png" alt="advantages" width="958" height="433" class="aligncenter size-full" />
+ </p>
+ </main>
+ </div>
+ </div>
+
+ <div id="and">
+ <div class="wrap cf">
+ <div class="and-row">
+ <div class="and-cell">
+ <img src="library/images/and.png" alt="" />
+ </div>
+ <div class="and-cell">
+ <p>
+ Apache Spot is functional after just one day and just keeps improving through feedback and machine learning.
+ </p>
+ </div>
+ </div>
+ </div>
+ </div>
+
+ <div id="how-it-works">
+ <div class="wrap cf">
+ <div class="m-all t-1of3 d-1of3">
+ <h1>How It Works</h1>
+ <p>
+ Apache Spot uses machine learning as a filter for separating bad traffic from benign and to characterize the unique behavior of network traffic. A proven process, of context enrichment, noise filtering, whitelisting and heuristics, is also applied to network data to produce a shortlist of most likely security threats.
+ </p>
+ <p class="btn-margin">
+ <a href="https://github.com/apache/incubator-spot" class="y-btn">More Info</a>
+ </p>
+ </div>
+ <div class="m-all t-2of3 d-2of3">
+ <img src="library/images/how-it-works.png" alt="" />
+ </div>
+ </div>
+ </div>
+
+ <div id="key-features">
+ <div class="wrap cf">
+ <h1>Key Features</h1>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/magnify-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Suspicious DNS packets</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Apache Spot is capable of performing deep-packet inspection of DNS traffic to build a profile of probable and improbable DNS payloads. After visualizing, normalizing, and conducting pattern searches, the analyst has a shortlist of the most likely threats present in DNS traffic.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/threat-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Threat Incident and Response</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Given an IP address, Apache Spot gathers all the characteristics about the communication associated with it – the “social network” of that IP address. Then Apache Spot builds a timeline of the conversations that originated with that IP.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/connects.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Suspicious Connects</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Apache Spot uses advanced machine learning to build a model of the machines on the network and their communication patterns. The connections between the machines that are the lowest probability are then visualized, filtered for noise, and searched for known patterns. The result is the most likely threat patterns in the data, a few hundred flows picked from billions.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/storyboard-icon.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Storyboard</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ After an analyst has investigated a threat, the need still exists to communicate the event up and across the organization. A “dashboard” gives quick answers to the questions you already know to ask. What the analyst requires is a “storyboard,” something that tells who, what, where, and how of the story in words and interactive visualizations.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/SPOT_OpenDataModel-Icon_v1.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Open Data Models</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Spot provides common open data model for network, endpoint, and user – Open Data Models. These Open Data Models provide a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
+ </p>
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell">
+ <img src="library/images/SPOT_Collabration-Icon_v2.png" alt="" />
+ </div>
+ <div class="table-cell">
+ <h3>Collaboration</h3>
+ </div>
+ </div>
+ </div>
+ <p>
+ Spot’s Open Data Models help organizations quickly share new analytics with one another as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
+ </p>
+ </div>
+
+ <div class="cf"></div>
+ <p class="btn-margin">
+ <a href="https://github.com/apache/incubator-spot" class="y-btn">More Info</a>
+ </p>
+ </div>
+ </div>
+
+ <div id="open-data-models">
+ <div class="wrap cf">
+ <h1 class="center">Apache Spot Open Data Models (ODM)</h1>
+ <div class="m-all t-1of2 d-1of2 center">
+ <img src="library/images/odm.png" alt="Apache Spot Open Data Models">
+ </div>
+ <div class="m-all t-1of2 d-1of2">
+ <p>The primary use case initially supported by Spot includes Network Traffic Analysis for network flows (Netflow, sflow, etc.), DNS and Proxy. The Spot open data model strategy aims to extend Spot capabilities to support a broader set of cybersecurity use cases.</p>
+ <h3>ODM at a Glance</h3>
+ <ul>
+ <li>Includes a growing catalog of packaged ingestion pipelines for common data sources</li>
+ <li>Enriched events provide full context leading to better analytics and faster incident response</li>
+ <li>Organizations maintain and control a single copy of their security data</li>
+ </ul>
+ <p class="btn-margin"><a href="project-components/open-data-models/" class="y-btn">Read More</a></p>
+ </div>
+ </div>
+ </div>
+
+ <div id="user-stories">
+ <div class="wrap cf">
+ <h1>Spot Fosters a Rich Application Ecosystem</h1>
+ <p class="btn-margin center">
+ Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
+ </p>
+
+ <p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
+
+ <div class="community">
+ <img src="library/images/community/endgame.png" alt="Endgame" />
+ <img src="library/images/community/intel.png" alt="Intel" />
+ <img src="library/images/community/webroot.png" alt="Webroot" />
+ <img src="library/images/community/jask.png" alt="Jask" />
+ <img src="library/images/community/cloudera.png" alt="Cloudera" />
+ <img src="library/images/community/cloudwick.png" alt="Cloudwick" />
+ <img src="library/images/community/cybraics.png" alt="Cybraics" />
+ <img src="library/images/community/centrify.png" alt="Centrify" />
+ <img src="library/images/community/ebay.png" alt="Ebay" />
+ <img src="library/images/community/semantix.png" alt="Ebay" />
+ <img src="library/images/community/rich-it.png" alt="Ebay" />
+
+ </div>
+
+ </div>
+ </div>
+
+ <div id="use-case">
+ <div class="wrap cf">
+
+ <h1>Use Case</h1>
+ <div class="quotes">
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/quote-person.png" alt="" />
+ <h3>Senior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/quote-person.png" alt="" />
+ <h3>Junior Analyst</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div class="table">
+ <div class="table-row">
+ <div class="table-cell quote-man">
+ <img src="library/images/quote-person.png" alt="" />
+ <h3>Decision Maker</h3>
+ </div>
+ <div class="table-cell">
+ <p>
+ ...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
+ </p>
+ </div>
+ </div>
+ </div>
+
+ </div>
+
+ </div>
+
+ <div class="arrow">
+ <div class="wrap cf">
+ <p>
+ Identify the needle in the haystack with <strong>patterns</strong> that provide insight into potential threats.
+ </p>
+ </div>
+ </div>
+ </div>
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/index.php b/index.php
deleted file mode 100755
index 2c20ba8..0000000
--- a/index.php
+++ /dev/null
@@ -1,283 +0,0 @@
-<?php include 'includes/config.php'; ?>
-
-<?php
-$bodyclass = "home";
-$pageTitle = "Apache Spot";
-$description = "";
-$currentPage = 'home';
-?>
-<?php include 'includes/header.php'; ?>
-
-
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all t-1of2 d-1of2">
- <h1>Apache Spot (Incubating)</h1>
- <h1 class="thin">A Community Approach to Fighting Cyber Threats</h1>
- </div>
- <div class="m-all t-1of2 d-1of2 contribute">
- <h3>Help Spot expand his hunting ground to see deeper into the darkness of cyber threats.</h3>
- <p class="btn-margin"><a href="<?php echo BASE_URL; ?>/contribute" class="y-btn">Become a Contributor</a></p>
- </div>
- </div>
- </div>
-
- <div id="at-a-glance">
- <div class="wrap cf">
- <h1>Apache Spot at a Glance</h1>
- <p>Apache Spot is a community-driven cybersecurity project, built from the ground up, to bring advanced analytics to all IT Telemetry data on an open, scalable platform. Spot expedites threat detection, investigation, and remediation via machine learning and consolidates all enterprise security data into a comprehensive IT telemetry hub based on open data models. Spot’s scalability and machine learning capabilities support an ecosystem of ML-based applications that can run [...]
- </div>
- </div>
-
- <div id="content">
- <div id="inner-content" class="wrap cf">
- <main id="main" class="m-all t-all d-all cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
- <h1 class="center">Apache Spot Advantages</h1>
- <p style="text-align: center;"><img src="library/images/advantages-1.png" alt="advantages" width="958" height="433" class="aligncenter size-full" />
- </p>
- </main>
- </div>
- </div>
-
- <div id="and">
- <div class="wrap cf">
- <div class="and-row">
- <div class="and-cell">
- <img src="library/images/and.png" alt="" />
- </div>
- <div class="and-cell">
- <p>
- Apache Spot is functional after just one day and just keeps improving through feedback and machine learning.
- </p>
- </div>
- </div>
- </div>
- </div>
-
- <div id="how-it-works">
- <div class="wrap cf">
- <div class="m-all t-1of3 d-1of3">
- <h1>How It Works</h1>
- <p>
- Apache Spot uses machine learning as a filter for separating bad traffic from benign and to characterize the unique behavior of network traffic. A proven process, of context enrichment, noise filtering, whitelisting and heuristics, is also applied to network data to produce a shortlist of most likely security threats.
- </p>
- <p class="btn-margin">
- <a href="https://github.com/apache/incubator-spot" class="y-btn">More Info</a>
- </p>
- </div>
- <div class="m-all t-2of3 d-2of3">
- <img src="library/images/how-it-works.png" alt="" />
- </div>
- </div>
- </div>
-
- <div id="key-features">
- <div class="wrap cf">
- <h1>Key Features</h1>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="library/images/magnify-icon.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Suspicious DNS packets</h3>
- </div>
- </div>
- </div>
- <p>
- Apache Spot is capable of performing deep-packet inspection of DNS traffic to build a profile of probable and improbable DNS payloads. After visualizing, normalizing, and conducting pattern searches, the analyst has a shortlist of the most likely threats present in DNS traffic.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="library/images/threat-icon.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Threat Incident and Response</h3>
- </div>
- </div>
- </div>
- <p>
- Given an IP address, Apache Spot gathers all the characteristics about the communication associated with it – the “social network” of that IP address. Then Apache Spot builds a timeline of the conversations that originated with that IP.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="library/images/connects.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Suspicious Connects</h3>
- </div>
- </div>
- </div>
- <p>
- Apache Spot uses advanced machine learning to build a model of the machines on the network and their communication patterns. The connections between the machines that are the lowest probability are then visualized, filtered for noise, and searched for known patterns. The result is the most likely threat patterns in the data, a few hundred flows picked from billions.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="library/images/storyboard-icon.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Storyboard</h3>
- </div>
- </div>
- </div>
- <p>
- After an analyst has investigated a threat, the need still exists to communicate the event up and across the organization. A “dashboard” gives quick answers to the questions you already know to ask. What the analyst requires is a “storyboard,” something that tells who, what, where, and how of the story in words and interactive visualizations.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="library/images/SPOT_OpenDataModel-Icon_v1.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Open Data Models</h3>
- </div>
- </div>
- </div>
- <p>
- Spot provides common open data model for network, endpoint, and user – Open Data Models. These Open Data Models provide a standard format of enriched event data that makes it easier to integrate cross application data to gain complete enterprise visibility and develop net new analytic functionality. Spot’s Open Data Models helps organizations quickly share new analytics with one another as new threats are discovered.
- </p>
- </div>
- <div class="m-all t-1of2 d-1of2">
- <div class="table">
- <div class="table-row">
- <div class="table-cell">
- <img src="library/images/SPOT_Collabration-Icon_v2.png" alt="" />
- </div>
- <div class="table-cell">
- <h3>Collaboration</h3>
- </div>
- </div>
- </div>
- <p>
- Spot’s Open Data Models help organizations quickly share new analytics with one another as new threats are discovered. And, with Hadoop, organizations able to run these analytics against comprehensive historic data sets, helping organizations identify past threats that have slipped through the cracks. With this capability, Spot aims to give security professionals the ability to collaborate like cybercriminals do.
- </p>
- </div>
-
- <div class="cf"></div>
- <p class="btn-margin">
- <a href="https://github.com/apache/incubator-spot" class="y-btn">More Info</a>
- </p>
- </div>
- </div>
-
- <div id="open-data-models">
- <div class="wrap cf">
- <h1 class="center">Apache Spot Open Data Models (ODM)</h1>
- <div class="m-all t-1of2 d-1of2 center">
- <img src="library/images/odm.png" alt="Apache Spot Open Data Models">
- </div>
- <div class="m-all t-1of2 d-1of2">
- <p>The primary use case initially supported by Spot includes Network Traffic Analysis for network flows (Netflow, sflow, etc.), DNS and Proxy. The Spot open data model strategy aims to extend Spot capabilities to support a broader set of cybersecurity use cases.</p>
- <h3>ODM at a Glance</h3>
- <ul>
- <li>Includes a growing catalog of packaged ingestion pipelines for common data sources</li>
- <li>Enriched events provide full context leading to better analytics and faster incident response</li>
- <li>Organizations maintain and control a single copy of their security data</li>
- </ul>
- <p class="btn-margin"><a href="<?php echo BASE_URL; ?>/project-components/open-data-models/" class="y-btn">Read More</a></p>
- </div>
- </div>
- </div>
-
- <div id="user-stories">
- <div class="wrap cf">
- <h1>Spot Fosters a Rich Application Ecosystem</h1>
- <p class="btn-margin center">
- Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
- </p>
-
- <p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
-
- <div class="community">
- <img src="library/images/community/endgame.png" alt="Endgame" />
- <img src="library/images/community/intel.png" alt="Intel" />
- <img src="library/images/community/webroot.png" alt="Webroot" />
- <img src="library/images/community/jask.png" alt="Jask" />
- <img src="library/images/community/cloudera.png" alt="Cloudera" />
- <img src="library/images/community/cloudwick.png" alt="Cloudwick" />
- <img src="library/images/community/cybraics.png" alt="Cybraics" />
- <img src="library/images/community/centrify.png" alt="Centrify" />
- <img src="library/images/community/ebay.png" alt="Ebay" />
- <img src="library/images/community/semantix.png" alt="Ebay" />
- <img src="library/images/community/rich-it.png" alt="Ebay" />
-
- </div>
-
- </div>
- </div>
-
- <div id="use-case">
- <div class="wrap cf">
-
- <h1>Use Case</h1>
- <div class="quotes">
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="library/images/quote-person.png" alt="" />
- <h3>Senior Analyst</h3>
- </div>
- <div class="table-cell">
- <p>
- ...that allows me to see and customize the data and scripts to my enviroment. I want control over how the solution works.”
- </p>
- </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="library/images/quote-person.png" alt="" />
- <h3>Junior Analyst</h3>
- </div>
- <div class="table-cell">
- <p>
- ...that automatically alerts me to actionable suspicious events and ways to optimize my network in a timely fashion. Help me investigate these events and tell the story across stakeholders in my organization.”
- </p>
- </div>
- </div>
- </div>
-
- <div class="table">
- <div class="table-row">
- <div class="table-cell quote-man">
- <img src="library/images/quote-person.png" alt="" />
- <h3>Decision Maker</h3>
- </div>
- <div class="table-cell">
- <p>
- ...tells me the story of what happened in a way I can understand so I can make decisions as a result.”
- </p>
- </div>
- </div>
- </div>
-
- </div>
-
- </div>
-
- <div class="arrow">
- <div class="wrap cf">
- <p>
- Identify the needle in the haystack with <strong>patterns</strong> that provide insight into potential threats.
- </p>
- </div>
- </div>
- </div>
-
-<?php include 'includes/prefooter.php'; ?>
-<?php include 'includes/footer.php'; ?>
\ No newline at end of file
diff --git a/category/index.php b/project-components/index.html
similarity index 100%
rename from category/index.php
rename to project-components/index.html
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
new file mode 100755
index 0000000..58d49a1
--- /dev/null
+++ b/project-components/ingestion/index.html
@@ -0,0 +1,205 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Ingestion - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children active">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li class="active"><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <!--
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all d-1of2 right-center">
+ <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
+ </div>
+ </div>
+ </div>-->
+
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Apache Spot Ingestion</h1>
+
+ <p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the dat [...]
+
+ <p><img src="../../library/images/ingestion.png" alt="" /></p>
+
+ <h3>Inside the Ingest</h3>
+
+ <h4><em>Spot-Collectors</em></h4>
+
+ <p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
+
+ <p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
+ <p>Once a file has been uploaded there two paths are available.</p>
+
+ <ol>
+ <li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
+ <li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
+ </ol>
+
+ <h4><em>Kafka</em></h4>
+
+ <p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
+
+ <h4><em>Spot Workers</em></h4>
+
+ <p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
+
+ <p>Currently there are two types of Spot Workers.</p>
+
+ <ol>
+ <li>Python workers use multithreading to process data with the defined parsers.</li>
+ <li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
+ </ol>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/project-components/ingestion/index.php b/project-components/ingestion/index.php
deleted file mode 100755
index 6305506..0000000
--- a/project-components/ingestion/index.php
+++ /dev/null
@@ -1,67 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "page";
-$pageTitle = "Ingestion - Apache Spot";
-$description = "";
-$currentPage = 'ingestion';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
- <div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Ingestion</h1>
-
- <p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the dat [...]
-
- <p><img src="../../library/images/ingestion.png" alt="" /></p>
-
- <h3>Inside the Ingest</h3>
-
- <h4><em>Spot-Collectors</em></h4>
-
- <p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
-
- <p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
- <p>Once a file has been uploaded there two paths are available.</p>
-
- <ol>
- <li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
- <li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
- </ol>
-
- <h4><em>Kafka</em></h4>
-
- <p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
-
- <h4><em>Spot Workers</em></h4>
-
- <p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
-
- <p>Currently there are two types of Spot Workers.</p>
-
- <ol>
- <li>Python workers use multithreading to process data with the defined parsers.</li>
- <li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
- </ol>
-
- </div>
- <!--<?php include '../../includes/download-sidebar.php';?>-->
- </div>
-
- </div>
-
-
-<?php include '../../includes/prefooter.php'; ?>
-<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
new file mode 100755
index 0000000..d0c7d42
--- /dev/null
+++ b/project-components/machine-learning/index.html
@@ -0,0 +1,183 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Machine Learning - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children active">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <!--
+ <div id="masthead">
+ <div class="wrap cf">
+ <div class="m-all d-1of2 right-center">
+ <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
+ </div>
+ </div>
+ </div>-->
+
+
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Apache Spot Machine Learning</h1>
+
+ <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
+
+ <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
+
+ <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
+
+ <p><img src="../../library/images/machine-learning.png" alt="" /></p>
+
+ <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
+
+ <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/project-components/machine-learning/index.php b/project-components/machine-learning/index.php
deleted file mode 100755
index 72de1ed..0000000
--- a/project-components/machine-learning/index.php
+++ /dev/null
@@ -1,47 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "page";
-$pageTitle = "Machine Learning - Apache Spot";
-$description = "";
-$currentPage = 'machine-learning';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
- <div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Machine Learning</h1>
-
- <p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
- <p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
- <p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common net [...]
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
- <p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
-
- <p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
- </div>
-
- <!--<?php include '../../includes/download-sidebar.php';?>-->
-
- </div>
-
- </div>
-
-
-<?php include '../../includes/prefooter.php'; ?>
-<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
new file mode 100755
index 0000000..7a39767
--- /dev/null
+++ b/project-components/open-data-models/index.html
@@ -0,0 +1,188 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Open Data Models - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children active">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li class="active"><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+
+ <div id="content">
+
+ <div class="wrap cf with-sidebar"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Apache Spot Open Data Model</h1>
+
+ <p>Many organizations have built threat detection capabilities leveraging myriad vendor solutions. This approach leads to many silos of data corresponding to each vendor and often results in storing multiple copies of the same data, as each vendor’s capability operates independently from the others. There is no single vendor able to cost-effectively store and analyze all the data required to detect threats and facilitate incident investigations and remediation.</p>
+
+ <p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection mo [...]
+
+ <p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
+
+ <p>The Apache Spot ODM enables organizations to:</p>
+ <ul>
+ <li>Store one copy of the security telemetry data and apply UNLIMITED analytics
+ <ul>
+ <li>Leverage out-of-the-box analytics powered by machine learning to detect threats in DNS, Flow and Proxy data</li>
+ <li>Build custom analytics to your desired specification</li>
+ <li>Plug-in third-party vendor analytics that interoperate with the ODM</li>
+ </ul>
+ </li>
+ <li>Share and/or reuse threat detection models, algorithms, ingest pipelines, visualizations and analytics across the Apache Spot community, due to a common data model.</li>
+ <li>Leverage all your security telemetry data to establish the context needed to better detect threats
+ <ul>
+ <li>Security logs</li>
+ <li>User, endpoint and network entity data</li>
+ <li>Threat intelligence data</li>
+ </ul>
+ </li>
+ <li>Avoid “lock-in” to a specific technology and gain needed analytic flexibility resultant from a shared, open data model.</li>
+ </ul>
+ </div>
+
+
+ </div>
+
+ </div>
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/project-components/open-data-models/index.php b/project-components/open-data-models/index.php
deleted file mode 100755
index 9b95d9f..0000000
--- a/project-components/open-data-models/index.php
+++ /dev/null
@@ -1,60 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "page";
-$pageTitle = "Open Data Models - Apache Spot";
-$description = "";
-$currentPage = 'open-data-models';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
- <div id="content">
-
- <div class="wrap cf with-sidebar"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Apache Spot Open Data Model</h1>
-
- <p>Many organizations have built threat detection capabilities leveraging myriad vendor solutions. This approach leads to many silos of data corresponding to each vendor and often results in storing multiple copies of the same data, as each vendor’s capability operates independently from the others. There is no single vendor able to cost-effectively store and analyze all the data required to detect threats and facilitate incident investigations and remediation.</p>
-
- <p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection mo [...]
-
- <p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
-
- <p>The Apache Spot ODM enables organizations to:</p>
- <ul>
- <li>Store one copy of the security telemetry data and apply UNLIMITED analytics
- <ul>
- <li>Leverage out-of-the-box analytics powered by machine learning to detect threats in DNS, Flow and Proxy data</li>
- <li>Build custom analytics to your desired specification</li>
- <li>Plug-in third-party vendor analytics that interoperate with the ODM</li>
- </ul>
- </li>
- <li>Share and/or reuse threat detection models, algorithms, ingest pipelines, visualizations and analytics across the Apache Spot community, due to a common data model.</li>
- <li>Leverage all your security telemetry data to establish the context needed to better detect threats
- <ul>
- <li>Security logs</li>
- <li>User, endpoint and network entity data</li>
- <li>Threat intelligence data</li>
- </ul>
- </li>
- <li>Avoid “lock-in” to a specific technology and gain needed analytic flexibility resultant from a shared, open data model.</li>
- </ul>
- </div>
-
- <!--<?php include '../../includes/download-sidebar.php';?>-->
-
- </div>
-
- </div>
-
-<?php include '../../includes/prefooter.php'; ?>
-<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
new file mode 100755
index 0000000..cb10290
--- /dev/null
+++ b/project-components/visualization/index.html
@@ -0,0 +1,204 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Visualization - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children active">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li class="active"><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+ <div id="content">
+
+ <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
+ <div class="main">
+ <h1 class="page-title">Visualization</h1>
+ <h3>Take advantage of Apache Spot's tools to perform further analysis over the suspicious activity detected by our machine learning algorithm</h3>
+
+ <h4>Suspicious</h4>
+
+ <p>Study <strong>suspicious</strong> network activity by looking at a list of security threats detected by Apache Spot's machine learning algorithm.</p>
+
+ <p><img src="../../library/images/suspicious.png" alt="" /></p>
+
+ <p>Have a nice view of your network, understand how devices interact with each other and easily spot threats while exploring a visual representation of suspicious activity.</p>
+
+ <p><img src="../../library/images/network.png" alt="" /></p>
+
+ <p>The following feature is powered by IPython notebooks which allows the users to switch back and forth from the 'easy mode' to the 'expert mode', where they can view and edit the code behind this panel via the web browser.</p>
+
+ <p>In the 'Notebook' panel, the form displayed is where the user can assign the level of risk for each connection and use that as feedback to train the Machine Learning model in future executions. Switching to the 'expert' mode, the user can adjust the criteria to filter the data, discarding results known to be non relevant to the analysis.</p>
+
+ <p><img src="../../library/images/notebook.png" alt="" /></p>
+
+ <p>As your investigation moves forward, get <strong>detailed</strong> information about a threat whenever you want to dig into an especific threat.</p>
+
+ <p><img src="../../library/images/details.png" alt="" /></p>
+
+ <h4>Threat Investigation</h4>
+
+ <p>The threat investigation panel represents the last step of analysis before displaying the storyboard. At this point, the security analysts can enter a custom review for a given threat to display.</p>
+
+ <h4>Storyboard</h4>
+
+ <p>Ready to present your findings? Go over your high risk security threats and request further information, making it easy for executives to undestand what is going on. Here is a list of some of the information you will get when your analyses comes to the end.</p>
+
+ <ul>
+ <li>Incident Progression</li>
+ <li>Impact Analysis</li>
+ <li>Geographic location</li>
+ <li>Incident Timeline</li>
+ </ul>
+
+ <h4>Ingest Summary</h4>
+
+ <p>Wondering about how much data have been ingested on your cluster? We provide a nice visualization which allows you to get this information.</p>
+
+ <p><img src="../../library/images/ingest-summary.png" alt="" /></p>
+
+ <p>The "scoring panel" as well as the "Threat investigation panel" are powered by Jupyter notebooks, <a href="https://jupyter-notebook-beginner-guide.readthedocs.io/en/latest/what_is_jupyter.html" target="_blank">(click here to learn more)</a>.</p>
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <div id="more-info">
+ <div class="wrap cf">
+ <p class="social-icons">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a><a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></span><a href="http://slack.apache-spot.io/" target="_blank"><img src="../../library/images/add-to-slack.png" alt="" class="add-to-slack" /></a></a>
+ </p>
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indi [...]
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/project-components/visualization/index.php b/project-components/visualization/index.php
deleted file mode 100755
index cd6b0a7..0000000
--- a/project-components/visualization/index.php
+++ /dev/null
@@ -1,79 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "page";
-$pageTitle = "Visualization - Apache Spot";
-$description = "";
-$currentPage = 'visualization';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <!--
- <div id="masthead">
- <div class="wrap cf">
- <div class="m-all d-1of2 right-center">
- <h1>Lorem ispum dolor sit amet, consectetur adipisicing elit</h1>
- </div>
- </div>
- </div>-->
-
-
- <div id="content">
-
- <div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
- <div class="main">
- <h1 class="page-title">Visualization</h1>
- <h3>Take advantage of Apache Spot's tools to perform further analysis over the suspicious activity detected by our machine learning algorithm</h3>
-
- <h4>Suspicious</h4>
-
- <p>Study <strong>suspicious</strong> network activity by looking at a list of security threats detected by Apache Spot's machine learning algorithm.</p>
-
- <p><img src="../../library/images/suspicious.png" alt="" /></p>
-
- <p>Have a nice view of your network, understand how devices interact with each other and easily spot threats while exploring a visual representation of suspicious activity.</p>
-
- <p><img src="../../library/images/network.png" alt="" /></p>
-
- <p>The following feature is powered by IPython notebooks which allows the users to switch back and forth from the 'easy mode' to the 'expert mode', where they can view and edit the code behind this panel via the web browser.</p>
-
- <p>In the 'Notebook' panel, the form displayed is where the user can assign the level of risk for each connection and use that as feedback to train the Machine Learning model in future executions. Switching to the 'expert' mode, the user can adjust the criteria to filter the data, discarding results known to be non relevant to the analysis.</p>
-
- <p><img src="../../library/images/notebook.png" alt="" /></p>
-
- <p>As your investigation moves forward, get <strong>detailed</strong> information about a threat whenever you want to dig into an especific threat.</p>
-
- <p><img src="../../library/images/details.png" alt="" /></p>
-
- <h4>Threat Investigation</h4>
-
- <p>The threat investigation panel represents the last step of analysis before displaying the storyboard. At this point, the security analysts can enter a custom review for a given threat to display.</p>
-
- <h4>Storyboard</h4>
-
- <p>Ready to present your findings? Go over your high risk security threats and request further information, making it easy for executives to undestand what is going on. Here is a list of some of the information you will get when your analyses comes to the end.</p>
-
- <ul>
- <li>Incident Progression</li>
- <li>Impact Analysis</li>
- <li>Geographic location</li>
- <li>Incident Timeline</li>
- </ul>
-
- <h4>Ingest Summary</h4>
-
- <p>Wondering about how much data have been ingested on your cluster? We provide a nice visualization which allows you to get this information.</p>
-
- <p><img src="../../library/images/ingest-summary.png" alt="" /></p>
-
- <p>The "scoring panel" as well as the "Threat investigation panel" are powered by Jupyter notebooks, <a href="https://jupyter-notebook-beginner-guide.readthedocs.io/en/latest/what_is_jupyter.html" target="_blank">(click here to learn more)</a>.</p>
- </div>
-
- <!--<?php include '../../includes/download-sidebar.php';?>-->
-
- </div>
-
- </div>
-
-
-<?php include '../../includes/prefooter.php'; ?>
-<?php include '../../includes/footer.php'; ?>
\ No newline at end of file
diff --git a/tag/github/index.html b/tag/github/index.html
new file mode 100755
index 0000000..ea7ce75
--- /dev/null
+++ b/tag/github/index.html
@@ -0,0 +1,211 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Github - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: github</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/tag/github/index.php b/tag/github/index.php
deleted file mode 100755
index fb1611c..0000000
--- a/tag/github/index.php
+++ /dev/null
@@ -1,57 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive tag";
-$pageTitle = "Github - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Tag: github</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
- </body>
-
-</html>
\ No newline at end of file
diff --git a/2016/index.php b/tag/index.html
similarity index 100%
rename from 2016/index.php
rename to tag/index.html
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
new file mode 100755
index 0000000..d797b2f
--- /dev/null
+++ b/tag/open-network-insight/index.html
@@ -0,0 +1,211 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Open Network Insight - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
+
+ <h1 class="page-title">Tag: open network insight</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/tag/open-network-insight/index.php b/tag/open-network-insight/index.php
deleted file mode 100755
index ad6965b..0000000
--- a/tag/open-network-insight/index.php
+++ /dev/null
@@ -1,59 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive tag";
-$pageTitle = "Open Network Insight - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Tag: open network insight</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
new file mode 100755
index 0000000..489d631
--- /dev/null
+++ b/tag/open-source/index.html
@@ -0,0 +1,211 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Open Source - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="../../favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="archive tag">
+
+ <div id="container">
+ <div class="social-sidebar">
+ <a href="mailto:info@open-network-insight.org"><span class="icon-envelope"></span></a>
+ <a href="https://twitter.com/ApacheSpot" target="_blank"><span class="icon-twitter"></a>
+ <a href="http://slack.apache-spot.io/" target="_blank"><span class="icon-slack"></span></a>
+ </div>
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="http://spot.incubator.apache.org/contribute">Contribute</a>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13 active">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div id="inner-content" class="wrap cf">
+
+ <main id="main" class="m-all t-2of3 d-5of7 cf">
+
+ <h1 class="page-title">Tag: open source</h1>
+
+ <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
+
+ <header class="entry-header article-header">
+
+ <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
+ <p class="byline entry-meta vcard">
+ <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
+ March 29, 2016
+ </time>
+ </span>
+ </p>
+
+ </header>
+
+ <section class="entry-content cf">
+
+ <p>
+ While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
+ </p>
+
+ </section>
+
+ <footer class="article-footer">
+
+ </footer>
+
+ </article>
+
+ </main>
+
+ <div id="sidebar1" class="sidebar m-all t-1of3 d-2of7 last-col cf" role="complementary">
+
+ <div id="recent-posts-2" class="widget widget_recent_entries">
+ <h4 class="widgettitle">Recent Posts</h4>
+ <ul>
+ <li>
+ <a href="../../blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
+ <a href="../../blog/jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ </li>
+ <li>
+ <a href="../../blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ </li>
+ <li>
+ <a href="../../blog/apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ </li>
+ </ul>
+ </div>
+ <div id="archives-2" class="widget widget_archive">
+ <h4 class="widgettitle">Archives</h4>
+ <ul>
+ <li>
+ <a href='../../2016/10/'>October 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/09/'>September 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/08/'>August 2016</a>
+ </li>
+ <li>
+ <a href='../../2016/03/'>March 2016</a>
+ </li>
+ </ul>
+ </div>
+
+ </div>
+
+ </div>
+
+ </div>
+
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
\ No newline at end of file
diff --git a/tag/open-source/index.php b/tag/open-source/index.php
deleted file mode 100755
index b8e749f..0000000
--- a/tag/open-source/index.php
+++ /dev/null
@@ -1,59 +0,0 @@
-<?php include '../../includes/config.php'; ?>
-<?php
-$bodyclass = "archive tag";
-$pageTitle = "Open Source - Apache Spot";
-$description = "";
-$currentPage = 'blog';
-?>
-<?php include '../../includes/header.php'; ?>
-
- <div id="content">
-
- <div id="inner-content" class="wrap cf">
-
- <main id="main" class="m-all t-2of3 d-5of7 cf" role="main" itemscope itemprop="mainContentOfPage" itemtype="http://schema.org/Blog">
-
- <h1 class="page-title">Tag: open source</h1>
-
- <article id="post-62" class="cf post-62 post type-post status-publish format-standard hentry category-security-analytics tag-github tag-apache-spot tag-open-source" role="article">
-
- <header class="entry-header article-header">
-
- <h3 class="h2 entry-title"><a href="../../blog/apache-spot-3-most-asked-questions/" rel="bookmark" title="Apache Spot: Three Most-Asked Questions">Apache Spot (Incubating): Three Most-Asked Questions</a></h3>
- <p class="byline entry-meta vcard">
- <time class="updated entry-time" datetime="2016-03-29" itemprop="datePublished">
- March 29, 2016
- </time>
- </span>
- </p>
-
- </header>
-
- <section class="entry-content cf">
-
- <p>
- While this is not the first blog post about Apache Spot, it is the first one by a creator of the solution. As a security data scientist in Intel’s Data Center Group, I joined a small team to start thinking about solving really hard problems in cloud analytics. The team grew, and out of that… <a class="excerpt-read-more" href="../../blog/apache-spot-3-most-asked-questions/" title="Read Apache Spot: Three Most-Asked Questions">Read more »</a>
- </p>
-
- </section>
-
- <footer class="article-footer">
-
- </footer>
-
- </article>
-
- </main>
-
- <?php include '../../includes/sidebar.php'; ?>
-
- </div>
-
- </div>
-
- <?php include '../../includes/footer.php'; ?>
-
- </body>
-
-</html>
-<!-- end of site. what a ride! -->
[incubator-spot] 41/45: Added substitute function and fixed GetRoot
to not be hardcoded.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit da375f8af2954f5c84e5e0da33fec3cbb0f6dfbf
Author: Mark Schoeni <ma...@gmail.com>
AuthorDate: Mon Dec 17 14:41:03 2018 -0600
Added substitute function and fixed GetRoot to not be hardcoded.
---
_Tools/page-massedit.py | 50 ++++++++++++++++++++++++++++++++++++++++++++-----
1 file changed, 45 insertions(+), 5 deletions(-)
diff --git a/_Tools/page-massedit.py b/_Tools/page-massedit.py
index 7514602..9f2b55a 100644
--- a/_Tools/page-massedit.py
+++ b/_Tools/page-massedit.py
@@ -9,6 +9,13 @@ print('Use this to make changes across all the Spot pages fast (mainly menus)')
print('This is a result of laziness; enjoy \n')
+def GetRootDir(rootName):
+ filePath = os.path.realpath(__file__)
+ pathSplit = filePath.split('\\')
+ idx = 1 + [i for i, s in enumerate(pathSplit) if rootName in s][-1]
+ return '\\'.join(pathSplit[0:idx])
+
+
def FindFiles(_rootDir, _pattern: str):
_fileList = []
@@ -47,6 +54,7 @@ def RegDelLines(_searchPattern, _files):
for line in oldFile:
pattern = re.compile(_searchPattern)
matches = pattern.findall(line)
+
if len(matches) == 0:
newFile.write(line)
else:
@@ -82,7 +90,34 @@ def RegInsertAfter(_searchPattern, _files, _line2Insert, _insertType):
os.remove(filePath + ".old")
-rootDir = "c:\\code\\incubator-spot" #input('enter directory:')
+def RegSubstitute(_searchPattern, _files, _text2Sub):
+ for filePath in _files:
+ baseName = os.path.basename(filePath)
+ newFileName = os.path.dirname(filePath) + "\\" + baseName + ".new"
+
+ with open(filePath, "r", encoding='utf-8') as oldFile:
+ # create swap file
+ with open(newFileName, "w", encoding='utf-8') as newFile:
+ for line in oldFile:
+ pattern = re.compile(_searchPattern)
+ matches = pattern.findall(line)
+
+ if len(matches) > 0:
+ for match in matches:
+ newLine = line.replace(match, _text2Sub)
+
+ newFile.write(newLine)
+ else:
+ newFile.write(line)
+
+
+ # Swap Files
+ os.rename(filePath, filePath + ".old")
+ os.rename(newFileName, filePath)
+ os.remove(filePath + ".old")
+
+
+rootDir = GetRootDir('incubator-spot')
files = FindFiles(rootDir, 'index.html')
@@ -90,7 +125,7 @@ searchPattern = input("Search Pattern:")
files = RegSearch(searchPattern, files)
-print("commands(DelLines / InsertAfter/ ...)")
+print("commands(DelLines / InsertAfter/ Sub)")
while True:
cmd = input("How to Proceed?: ")
@@ -101,7 +136,7 @@ while True:
# Insert After
elif cmd.lower() == 'insertafter':
- insertType = input('append (app) or next line (nl)')
+ insertType = input('append (app) or next line (nl):')
# normalise
if insertType in ['app', 'append']:
@@ -115,13 +150,18 @@ while True:
else:
print("Invalid Insertion Type")
+ # Substitute
+ elif cmd.lower() == 'sub':
+ subText = input('Text to substitute with:')
+ RegSubstitute(searchPattern, files, subText)
+
# Regex Replace
- elif cmd == 'regex':
+ elif cmd.lower() == 'regex':
print("Not Implemented Yet")
#massedit.edit_files(files, ["re.sub()"])
# Quit
- elif cmd in ['q', 'quit']:
+ elif cmd in ['q', 'quit', 'exit']:
break
# ?!?
[incubator-spot] 39/45: Ignoring Node_Modules folder for the site.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 33ab5bd317474191f0a20ea9fa4799ca275b6590
Author: Mark Schoeni <ma...@gmail.com>
AuthorDate: Mon Dec 3 16:50:28 2018 -0600
Ignoring Node_Modules folder for the site.
---
.gitignore | 1 +
1 file changed, 1 insertion(+)
diff --git a/.gitignore b/.gitignore
new file mode 100644
index 0000000..3c3629e
--- /dev/null
+++ b/.gitignore
@@ -0,0 +1 @@
+node_modules
[incubator-spot] 28/45: Per Incubator board request,
replacing the name of Dowload section until Apache Release process
for Spot is completed. Changing to GitHub
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit edeeb66bf3d2bcfe227944e96d2dc2c1ff96f84e
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Thu Jul 27 20:43:01 2017 -0500
Per Incubator board request, replacing the name of Dowload section until Apache Release process for Spot is completed. Changing to GitHub
---
index.html | 34 +++++++++++++++++-----------------
1 file changed, 17 insertions(+), 17 deletions(-)
diff --git a/index.html b/index.html
index 8623bc6..021a820 100755
--- a/index.html
+++ b/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -70,13 +70,13 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="community" class="mail">Mailing Lists</a></li>
+ <li><a href="community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="community/committers">Project Committers</a></li>
@@ -126,7 +126,7 @@
</div>
</div>
</div>
-
+
<div id="at-a-glance">
<div class="wrap cf">
<h1>Apache Spot at a Glance</h1>
@@ -276,7 +276,7 @@
</p>
</div>
</div>
-
+
<div id="open-data-models">
<div class="wrap cf">
<h1 class="center">Apache Spot Open Data Models (ODM)</h1>
@@ -302,9 +302,9 @@
<p class="btn-margin center">
Spot accelerates the development of cybersecurity applications by providing a cybersecurity analytics framework. This means more solutions can be created faster. This is because Spot allows organizations to focus developing the analytics and visualizations for applications that discover cybercrime rather than spending time building systems to ingest, integrate, store, and process myriad volumes or varieties of security data.
</p>
-
+
<p class="center">Join the Apache Spot community and collaborate with us using a common framework.</p>
-
+
<div class="community">
<img src="library/images/community/endgame.png" alt="Endgame" />
<img src="library/images/community/intel.png" alt="Intel" />
@@ -316,8 +316,8 @@
<img src="library/images/community/centrify.png" alt="Centrify" />
<img src="library/images/community/ebay.png" alt="Ebay" />
<img src="library/images/community/semantix.png" alt="Semantix" />
- <img src="library/images/community/rich-it.png" alt="Rich-It" />
- <img src="library/images/community/streamsets.png" alt="StreamSets" />
+ <img src="library/images/community/rich-it.png" alt="Rich-It" />
+ <img src="library/images/community/streamsets.png" alt="StreamSets" />
</div>
</div>
@@ -360,7 +360,7 @@
<div class="table">
<div class="table-row">
<div class="table-cell quote-man">
- <img src="library/images/Apache-Spot-Icon_Threat-Hunting.png" alt="" />
+ <img src="library/images/Apache-Spot-Icon_Threat-Hunting.png" alt="" />
</div>
<div class="table-cell">
<h3>Threat Hunting</h3>
@@ -370,20 +370,20 @@
</div>
</div>
</div>
-
+
<div class="table">
<div class="table-row">
<div class="table-cell quote-man">
- <img src="library/images/Apache-Spot-Icon_Cybersecurity-Data-Management.png" alt="" />
+ <img src="library/images/Apache-Spot-Icon_Cybersecurity-Data-Management.png" alt="" />
</div>
<div class="table-cell">
<h3>Cybersecurity Data Management</h3>
<p>
- Offloading data from legacy cybersecurity systems (e.g., SIEMs) to Spot delivers immediate economic value, because of the cost of data storage and processing with Hadoop. It also opens up future value as organizations deploy one of the many analytics use cases on their newly formed security data hub.
+ Offloading data from legacy cybersecurity systems (e.g., SIEMs) to Spot delivers immediate economic value, because of the cost of data storage and processing with Hadoop. It also opens up future value as organizations deploy one of the many analytics use cases on their newly formed security data hub.
</p>
</div>
</div>
- </div>
+ </div>
</div>
@@ -397,7 +397,7 @@
</div>
</div>
</div>
-
+
<div id="more-info">
<div class="wrap cf">
@@ -436,4 +436,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
[incubator-spot] 07/45: Fixing Inconsistent/incorrect use of Apache
trademark on the blog entry Jupyter Notebooks for Data Analysis
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit bbc11dab3b5f4e4a1cf1bf8ab57eaf1f9f6b7fbc
Author: cesar <ce...@apache.org>
AuthorDate: Mon Oct 17 17:46:20 2016 -0500
Fixing Inconsistent/incorrect use of Apache trademark on the blog entry Jupyter Notebooks for Data Analysis
---
jupyter-notebooks-for-data-analysis/index.html | 34 +++++++++++++-------------
1 file changed, 17 insertions(+), 17 deletions(-)
diff --git a/jupyter-notebooks-for-data-analysis/index.html b/jupyter-notebooks-for-data-analysis/index.html
index cbd0e04..3d29fa1 100644
--- a/jupyter-notebooks-for-data-analysis/index.html
+++ b/jupyter-notebooks-for-data-analysis/index.html
@@ -12,7 +12,7 @@
<meta http-equiv="X-UA-Compatible" content="IE=edge">
- <title>Apache Spot Jupyter Notebooks for Data Analysis</title>
+ <title>Apache Spot (Incubating) Jupyter Notebooks for Data Analysis</title>
<meta name="HandheldFriendly" content="True">
<meta name="MobileOptimized" content="320">
@@ -29,9 +29,9 @@
<link rel="pingback" href="http://spot.incubator.apache.org/xmlrpc.php">
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="http://spot.incubator.apache.org/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="http://spot.incubator.apache.org/comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot » Jupyter Notebooks for Data Analysis Comments Feed" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Feed" href="http://spot.incubator.apache.org/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Comments Feed" href="http://spot.incubator.apache.org/comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Jupyter Notebooks for Data Analysis Comments Feed" href="http://spot.incubator.apache.org/jupyter-notebooks-for-data-analysis/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/72x72\/",
@@ -184,10 +184,10 @@
</header>
<section class="entry-content cf" itemprop="articleBody">
<p>
- <strong>Why Does Apache Spot Include iPython notebooks? </strong>
+ <strong>Why Does Apache Spot (Incubating) Include iPython notebooks? </strong>
</p>
<p>
- The project team wants Apache Spot to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debugging in an i [...]
+ The project team wants Apache Spot (Incubating) to be a versatile tool that can be used by anyone. This means that data scientists and developers need to be able to query and handle the source data to find all the information they need for their decision making. The iPython Notebook is an appropriate platform for easy data exploration. One of its biggest advantages is that it provides parallel and distributed computing to enable code execution and debu [...]
</p>
<p>
The iPython notebook is a web based interactive computational environment that provides access to the Python shell. While iPython notebooks were originally designed to work with the Python language, they support a number of other programming languages, including Ruby, Scala, Julia, R, Go, C, C++, Java and Perl. There are also multiple additional packages that can be used to get the most out of this highly-customizable tool.
@@ -197,13 +197,13 @@
</p>
<img src="../wp-content/uploads/2016/10/iPython-1.png" alt="ipython" width="361" height="107" class="aligncenter size-full wp-image-140" srcset="../wp-content/uploads/2016/10/iPython-1.png 361w, ../wp-content/uploads/2016/10/iPython-1-300x89.png 300w" sizes="(max-width: 361px) 100vw, 361px" />
<p>
- <strong>IPython with Apache Spot for Network Threat Detection</strong>
+ <strong>IPython with Apache Spot (Incubating) for Network Threat Detection</strong>
</p>
<p>
- <em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot, but more like an introduction on how to approach the suspicions of a security breach.</em>
+ <em>NOTE: This is not intended to be a step-by-step tutorial on how to code a threat analysis in Apache Spot (Incubating), but more like an introduction on how to approach the suspicions of a security breach.</em>
</p>
<p>
- Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the chance to ge [...]
+ Although machine learning (ML) will do most of the work detecting anomalies in the traffic, Apache Spot (Incubating) also includes two notebook templates that can get you started on this. The <em>Threat_Investigation_master.ipynb</em> is designed to query the raw data table to find all connections in a day that are related to any threat you select – even connections that were not necessarily flagged as suspicious by ML on a first run. This gives us the [...]
</p>
<p>
If you suspect of a specific type of attack in your network, you can get the whole story by answering the Five ‘W’s.
@@ -218,7 +218,7 @@
<strong><em>Who?</em></strong>
</p>
<p>
- Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot is really simple and can go a [...]
+ Assuming you have a network context, you can identify the name of the infected machine inside the network, as well as the name of the IP or DNS on the other side of the connection (if it is a known host). If you don’t have a network context or are using DHCP, this can be a little tricky to detect using only Netflow logs. But, that’s where DNS and Proxy logs, come in handy. Including a network context file with Apache Spot (Incubating) is really simple [...]
</p>
<p>
<strong><em>When?</em></strong>
@@ -230,7 +230,7 @@
<strong><em>Where?</em></strong>
</p>
<p>
- When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.
+ When working only with DNS, having a destination URL might not say much about where your information is going to, but Apache Spot (Incubating) allows you to connect with a geolocation database to identify the location of the suspected attackers IP. Taking advantage of this option, you can visually locate the other end of the connection on a map. You might find that it’s pointing to a country banned by your company, indicating a leak.
</p>
<p>
<strong><em>Why?</em></strong>
@@ -251,10 +251,10 @@
<strong>Wrap Up</strong>
</p>
<p>
- This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.
+ This post was meant to be just a brief introduction of how you can use iPython notebooks in Apache Spot (Incubating) to perform further data analysis and include it our executive report (in addition to the already included Story board). Although this is not the only way you can do this, it is a very interactive and fun way to do it. You’ll also see that the overall processing time is very short – thanks to the iPython notebook task parallelism ability.
</p>
<p>
- We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.
+ We want to hear from YOU! Have you used iPython notebooks before? How do you feel about having this tool in Apache Spot (Incubating)? If you’re interested in further data analysis through interactive charts, a new post is coming soon on D3 and jQuery data visualization. Also, check back soon to read more on this and other Cybersecurity subjects.
</p>
</section>
@@ -277,13 +277,13 @@
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
- <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
+ <a href="../apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/">Apache Spot (Incubating) (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure</a>
</li>
<li>
- <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
+ <a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/">How Apache Spot (Incubating) (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</a>
</li>
<li>
- <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating): 3 Most-Asked Questions</a>
+ <a href="../apache-spot-3-most-asked-questions/">Apache Spot (Incubating) (Incubating): 3 Most-Asked Questions</a>
</li>
</ul>
</div>
@@ -314,7 +314,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot.
+ © 2016 Apache Spot (Incubating).
</p>
</div>
[incubator-spot] 01/45: Create master.
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit f52bc83270d807f8b9f8e6fe8e8b764da4d87fcb
Author: Doug Cutting <cu...@apache.org>
AuthorDate: Tue Sep 27 08:58:20 2016 -0700
Create master.
---
README.txt | 1 +
1 file changed, 1 insertion(+)
diff --git a/README.txt b/README.txt
new file mode 100644
index 0000000..3e69953
--- /dev/null
+++ b/README.txt
@@ -0,0 +1 @@
+Apache Spot README
[incubator-spot] 15/45: Updating links to new GitHub branch Spot,
prior moving code to ASF
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit bb79a11ac2192bd867af53ff85e6e79d5f0bf1e2
Author: Cesar <ce...@apache.org>
AuthorDate: Sun Oct 30 12:55:45 2016 -0400
Updating links to new GitHub branch Spot, prior moving code to ASF
---
2016/03/index.html | 6 ++---
2016/08/index.html | 6 ++---
2016/09/index.html | 6 ++---
2016/10/index.html | 6 ++---
apache-spot-3-most-asked-questions/feed/index.html | 0
apache-spot-3-most-asked-questions/index.html | 12 +++++++---
.../feed/index.html | 0
.../index.html | 26 +++++++++++++---------
blog/index.html | 6 ++---
category/cybersecurity/index.html | 6 ++---
category/data-science/index.html | 6 ++---
category/ipython-notebooks/index.html | 6 ++---
category/security-analytics/index.html | 6 ++---
category/threat-analysis-tools/index.html | 6 ++---
category/uncategorized/index.html | 6 ++---
index.html | 6 ++---
tag/github/index.html | 6 ++---
tag/open-network-insight/index.html | 6 ++---
tag/open-source/index.html | 6 ++---
19 files changed, 70 insertions(+), 58 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 1476bb7..bcc75f7 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -142,13 +142,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/2016/08/index.html b/2016/08/index.html
index 61e3284..4c7aef7 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -142,13 +142,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/2016/09/index.html b/2016/09/index.html
index 7945acb..a57b337 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -132,13 +132,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/2016/10/index.html b/2016/10/index.html
index 4c7dd4d..a10c181 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -131,13 +131,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/apache-spot-3-most-asked-questions/feed/index.html b/apache-spot-3-most-asked-questions/feed/index.html
old mode 100644
new mode 100755
diff --git a/apache-spot-3-most-asked-questions/index.html b/apache-spot-3-most-asked-questions/index.html
old mode 100644
new mode 100755
index e0cbedd..998e416
--- a/apache-spot-3-most-asked-questions/index.html
+++ b/apache-spot-3-most-asked-questions/index.html
@@ -147,13 +147,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
@@ -248,6 +248,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -265,6 +268,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../2016/09/'>September 2016</a>
</li>
<li>
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/index.html
old mode 100644
new mode 100755
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
old mode 100644
new mode 100755
index f764e54..e811bbb
--- a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -31,9 +31,9 @@
<link rel='dns-prefetch' href='//fonts.googleapis.com' />
<link rel='dns-prefetch' href='//s.w.org' />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Feed" href="../feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Comments Feed" href="../comments/feed/" />
- <link rel="alternate" type="application/rss+xml" title="Apache Spot (Incubating) » Apache Spot (Incubating) and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure Comments Feed" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Comments Feed" href="../comments/feed/" />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Apache Spot and Cybersecurity — Using NetFlows to Detect Threats to Critical Infrastructure Comments Feed" href="../open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/feed/" />
<script type="text/javascript">
window._wpemojiSettings = {
"baseUrl" : "https:\/\/s.w.org\/images\/core\/emoji\/2\/72x72\/",
@@ -147,13 +147,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
@@ -222,16 +222,16 @@
First idea: Use NetFlow, which is a network protocol that helps us collect IP traffic information and monitor network traffic. NetFlow has the details on the communications of all of your network traffic. However, the normal data on an enterprise environment includes billions of NetFlow events per day. To use this data to identify issues, it must be stored and analyzed. Storage alone is costly. Analyzing what amount Big Data stores is an entire other c [...]
</p>
<p>
- Apache Spot (Incubating) offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot (Incubating) is an ideal solution for this cybersecurity challenge. Apache Spot (Incubating) can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different at [...]
+ Apache Spot offers a solution. It was designed to gather, store and analyze Big Data. In fact, Apache Spot is an ideal solution for this cybersecurity challenge. Apache Spot can integrate many different data sources in a data lake then add operational context to the data by linking configuration, inventory, service databases and other data stores. This helps you to prioritize the actions to take under different attack, malware, APT and hacking scenario [...]
</p>
<p>
- Not only can Apache Spot (Incubating) collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot (Incubating) is an open-source project.
+ Not only can Apache Spot collect, store and analyze billions of NetFlow packets, but it can also be adapted to meet the unique requirements of your organization. How? Apache Spot is an open-source project.
</p>
<p>
<strong>But Wait, There’s More</strong>
</p>
<p>
- Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot (Incubating) Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot (Incubating) architecture.
+ Check out “<a href="../how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/"><u>How Apache Spot Helps Create Well-Stocked Data Lakes and Catch Powerful Insights</u></a>” to learn more about the underlying Apache Spot architecture.
</p>
<p>
This is the first of a series of blogs that we will be writing about cybersecurity, so check back to read more.
@@ -253,6 +253,9 @@
<h4 class="widgettitle">Recent Posts</h4>
<ul>
<li>
+ <a href="../strength-in-numbers-why-consider-open-source-cybersecurity-analytics/">Strength in Numbers: Why Consider Open Source Cybersecurity Analytics</a>
+ </li>
+ <li>
<a href="../jupyter-notebooks-for-data-analysis/">Jupyter Notebooks for Data Analysis</a>
</li>
<li>
@@ -270,6 +273,9 @@
<h4 class="widgettitle">Archives</h4>
<ul>
<li>
+ <a href='../2016/10/'>October 2016</a>
+ </li>
+ <li>
<a href='../2016/09/'>September 2016</a>
</li>
<li>
@@ -293,7 +299,7 @@
<nav role="navigation"></nav>
<p class="source-org copyright" style="text-align:center;">
- © 2016 Apache Spot (Incubating).
+ © 2016 Apache Spot.
</p>
</div>
diff --git a/blog/index.html b/blog/index.html
index 9ef59c2..b7df948 100755
--- a/blog/index.html
+++ b/blog/index.html
@@ -142,13 +142,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 9b9813c..4dfdda1 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -144,13 +144,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index 5138c39..879d3ef 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -133,13 +133,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index eb22952..e5e1bff 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -133,13 +133,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index fed54c5..686c958 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -143,13 +143,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index 7220abd..9db73e5 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -133,13 +133,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-4" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-4">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-7" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-7">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index e9962d5..aaf4fa4 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -143,13 +143,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/index.html b/index.html
index b7c146b..3b138ba 100755
--- a/index.html
+++ b/index.html
@@ -147,13 +147,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/tag/github/index.html b/tag/github/index.html
index 1392375..80783c0 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -143,13 +143,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index b648c87..e694d09 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -143,13 +143,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index 304768c..64e0e47 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -143,13 +143,13 @@
<nav role="navigation" itemscope itemtype="http://schema.org/SiteNavigationElement">
<ul id="menu-main-menu" class="nav top-nav cf">
<li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
</li>
<li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/wiki">Wiki</a>
[incubator-spot] 31/45: Update to Spot website removing any
Download references until Apache Release is completed
Posted by le...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
leahy pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-spot.git
commit 1f9966e96e37aa3762b71aa98fcee36303cfc1b2
Author: Cesar Berho <ce...@apache.org>
AuthorDate: Wed Aug 9 00:27:34 2017 -0500
Update to Spot website removing any Download references until Apache Release is completed
---
2016/03/index.html | 2 +-
2016/08/index.html | 2 +-
2016/09/index.html | 2 +-
2016/10/index.html | 2 +-
2017/03/index.html | 2 +-
apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
blog/apache-spot-product-architecture-overview/index.html | 2 +-
.../index.html | 2 +-
blog/jupyter-notebooks-for-data-analysis/index.html | 2 +-
.../index.html | 2 +-
category/cybersecurity/index.html | 2 +-
category/data-science/index.html | 2 +-
category/ipython-notebooks/index.html | 2 +-
category/security-analytics/index.html | 2 +-
category/threat-analysis-tools/index.html | 2 +-
category/uncategorized/index.html | 2 +-
community/committers/index.html | 2 +-
community/contribute/index.html | 2 +-
community/index.html | 2 +-
doc/index.html | 2 +-
.../index.html | 2 +-
.../index.html | 2 +-
includes/download-sidebar.php | 2 +-
includes/header.php | 2 +-
index.html | 2 +-
open-network-insight-3-most-asked-questions/index.html | 2 +-
.../index.html | 2 +-
project-components/ingestion/index.html | 2 +-
project-components/machine-learning/index.html | 2 +-
project-components/open-data-models/index.html | 2 +-
project-components/visualization/index.html | 2 +-
.../index.html | 2 +-
tag/github/index.html | 2 +-
tag/open-network-insight/index.html | 2 +-
tag/open-source/index.html | 2 +-
38 files changed, 38 insertions(+), 38 deletions(-)
diff --git a/2016/03/index.html b/2016/03/index.html
index 4c841fb..b733b5c 100755
--- a/2016/03/index.html
+++ b/2016/03/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/2016/08/index.html b/2016/08/index.html
index 0e77f80..5df564b 100755
--- a/2016/08/index.html
+++ b/2016/08/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/2016/09/index.html b/2016/09/index.html
index 0586461..f779703 100755
--- a/2016/09/index.html
+++ b/2016/09/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/2016/10/index.html b/2016/10/index.html
index 0caaa24..987a412 100755
--- a/2016/10/index.html
+++ b/2016/10/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/2017/03/index.html b/2017/03/index.html
index 126cb29..48afb8c 100755
--- a/2017/03/index.html
+++ b/2017/03/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/apache-spot-3-most-asked-questions/index.html b/apache-spot-3-most-asked-questions/index.html
index 998e416..437019a 100755
--- a/apache-spot-3-most-asked-questions/index.html
+++ b/apache-spot-3-most-asked-questions/index.html
@@ -150,7 +150,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
diff --git a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index e811bbb..106ec57 100755
--- a/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -150,7 +150,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#if-you-want-all-of-the-apache-spot-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight/tree/spot#contributing-to-apache-spot">Contribute</a>
diff --git a/blog/apache-spot-3-most-asked-questions/index.html b/blog/apache-spot-3-most-asked-questions/index.html
index b8b8a89..6620b79 100755
--- a/blog/apache-spot-3-most-asked-questions/index.html
+++ b/blog/apache-spot-3-most-asked-questions/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 32efdf4..baa4974 100755
--- a/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/blog/apache-spot-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/blog/apache-spot-product-architecture-overview/index.html b/blog/apache-spot-product-architecture-overview/index.html
index 8de99c2..ed02a39 100755
--- a/blog/apache-spot-product-architecture-overview/index.html
+++ b/blog/apache-spot-product-architecture-overview/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index b281029..ed63c00 100755
--- a/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/blog/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/blog/jupyter-notebooks-for-data-analysis/index.html b/blog/jupyter-notebooks-for-data-analysis/index.html
index 69b2ea2..4ed253b 100755
--- a/blog/jupyter-notebooks-for-data-analysis/index.html
+++ b/blog/jupyter-notebooks-for-data-analysis/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 33151e4..3fbdc20 100755
--- a/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/blog/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/category/cybersecurity/index.html b/category/cybersecurity/index.html
index 77669d7..eddbde7 100755
--- a/category/cybersecurity/index.html
+++ b/category/cybersecurity/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/category/data-science/index.html b/category/data-science/index.html
index e9f2290..644d6b7 100755
--- a/category/data-science/index.html
+++ b/category/data-science/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/category/ipython-notebooks/index.html b/category/ipython-notebooks/index.html
index cfb07ca..5af9f52 100755
--- a/category/ipython-notebooks/index.html
+++ b/category/ipython-notebooks/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/category/security-analytics/index.html b/category/security-analytics/index.html
index 436d11e..526ef25 100755
--- a/category/security-analytics/index.html
+++ b/category/security-analytics/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/category/threat-analysis-tools/index.html b/category/threat-analysis-tools/index.html
index d882df0..e30026a 100755
--- a/category/threat-analysis-tools/index.html
+++ b/category/threat-analysis-tools/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/category/uncategorized/index.html b/category/uncategorized/index.html
index bc1fe9c..adaa02a 100755
--- a/category/uncategorized/index.html
+++ b/category/uncategorized/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/community/committers/index.html b/community/committers/index.html
index 094744e..17fad87 100755
--- a/community/committers/index.html
+++ b/community/committers/index.html
@@ -78,7 +78,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">Download</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
diff --git a/community/contribute/index.html b/community/contribute/index.html
index ddb5eda..3015e3a 100755
--- a/community/contribute/index.html
+++ b/community/contribute/index.html
@@ -78,7 +78,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../../download">Download</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../../community">Community</a>
diff --git a/community/index.html b/community/index.html
index b68c205..f7a0b98 100755
--- a/community/index.html
+++ b/community/index.html
@@ -78,7 +78,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="../download">Download</a>
+ <a href="../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 active">
<a href="../community">Community</a>
diff --git a/doc/index.html b/doc/index.html
index 48a85c6..a088763 100755
--- a/doc/index.html
+++ b/doc/index.html
@@ -525,7 +525,7 @@
</p><br>
</li>
<li>
- <p class="short-mrg">Spark-Streaming – Download the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name). <strong>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</strong></p>
+ <p class="short-mrg">Spark-Streaming – GitHub the following jar file: spark-streaming-kafka-0-8-assembly_2.11. This jar adds support for Spark Streaming + Kafka and needs to be downloaded on the following path: spot-ingest/common (with the same name). <strong>Currently spark streaming is only enabled for proxy pipeline, if you are not planning to ingest proxy data you can skip this step.</strong></p>
<p class="terminal">
cd spot-ingest/common<br>
wget https://repo1.maven.org/maven2/org/apache/spark/spark-streaming-kafka- 0-8-assembly_2.11/2.0.0/spark-streaming-kafka-0-8-assembly_2.11-2.0.0.jar
diff --git a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 2d2b725..f42e280 100644
--- a/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-apache-spot-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -150,7 +150,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
diff --git a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
index 5902ac9..1879cbe 100644
--- a/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
+++ b/how-open-network-insight-helps-create-well-stocked-data-lakes-and-catch-powerful-insights/index.html
@@ -168,7 +168,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
diff --git a/includes/download-sidebar.php b/includes/download-sidebar.php
index 7679c2b..e8775cf 100755
--- a/includes/download-sidebar.php
+++ b/includes/download-sidebar.php
@@ -1,5 +1,5 @@
<div class="m-all t-all d-1of3 downloads">
- <h1>Downloads</h1>
+ <h1>GitHubs</h1>
<ul>
<li><a href="#">Lorem Ipsum Dolor SIT AMET <span class="icon-keyboard_arrow_right"></span></a></li>
<li><a href="#">Consectetur adipisicing elit sed <span class="icon-keyboard_arrow_right"></span></a></li>
diff --git a/includes/header.php b/includes/header.php
index 16e8062..d3d8801 100755
--- a/includes/header.php
+++ b/includes/header.php
@@ -86,7 +86,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130 <?php if($currentPage =='contribute'){echo 'active';}?>">
<a target="_blank" href="<?php echo BASE_URL; ?>/contribute" target="_blank">Contribute</a>
diff --git a/index.html b/index.html
index f3ac606..140c4ba 100755
--- a/index.html
+++ b/index.html
@@ -77,7 +77,7 @@
</ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a href="download">Download</a>
+ <a href="download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="community">Community</a>
diff --git a/open-network-insight-3-most-asked-questions/index.html b/open-network-insight-3-most-asked-questions/index.html
index 7d98703..6dec097 100644
--- a/open-network-insight-3-most-asked-questions/index.html
+++ b/open-network-insight-3-most-asked-questions/index.html
@@ -168,7 +168,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
diff --git a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
index 7a7cc0e..7424fd1 100644
--- a/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
+++ b/open-network-insight-oni-and-cybersecurity-using-netflows-to-detect-threats-to-critical-infrastructure/index.html
@@ -168,7 +168,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 2abe9c9..6949f4c 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 3156c0d..72c8d01 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 338e9d9..7c4ac19 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/project-components/visualization/index.html b/project-components/visualization/index.html
index 9e89f3c..a42f08c 100755
--- a/project-components/visualization/index.html
+++ b/project-components/visualization/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
index 9a70d55..90e2cfa 100755
--- a/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
+++ b/strength-in-numbers-why-consider-open-source-cybersecurity-analytics/index.html
@@ -140,7 +140,7 @@
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">Download</a>
+ <a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#if-you-want-all-of-the-oni-code-at-once-just-clone-it">GitHub</a>
</li>
<li id="menu-item-6" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-6">
<a target="_blank" href="https://github.com/Open-Network-Insight/open-network-insight#contributing-to-oni">Contribute</a>
diff --git a/tag/github/index.html b/tag/github/index.html
index 29aed27..d6a1903 100755
--- a/tag/github/index.html
+++ b/tag/github/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/tag/open-network-insight/index.html b/tag/open-network-insight/index.html
index 5779bc3..3fe1291 100755
--- a/tag/open-network-insight/index.html
+++ b/tag/open-network-insight/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
diff --git a/tag/open-source/index.html b/tag/open-source/index.html
index d853d82..ad94a4b 100755
--- a/tag/open-source/index.html
+++ b/tag/open-source/index.html
@@ -71,7 +71,7 @@
<a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">Download</a>
+ <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>