You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spot.apache.org by ce...@apache.org on 2017/08/09 05:46:20 UTC
[2/2] incubator-spot git commit: Normalizing latest sections with
proper pointers, to repair broken links
Normalizing latest sections with proper pointers, to repair broken links
Project: http://git-wip-us.apache.org/repos/asf/incubator-spot/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-spot/commit/bc57d11d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-spot/tree/bc57d11d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-spot/diff/bc57d11d
Branch: refs/heads/asf-site
Commit: bc57d11dd11fdfc1e794c6ac58eae13ec1ea2c60
Parents: 1f9966e
Author: Cesar Berho <ce...@apache.org>
Authored: Wed Aug 9 00:46:01 2017 -0500
Committer: Cesar Berho <ce...@apache.org>
Committed: Wed Aug 9 00:46:01 2017 -0500
----------------------------------------------------------------------
get-started/architecture/index.html | 181 ++++++++
get-started/demo/index.html | 184 ++++++++
get-started/environment/index.html | 189 ++++++++
get-started/index.html | 227 +++++++++
get-started/supporting-apache/index.html | 222 +++++++++
project-components/ingestion/index.html | 61 +--
project-components/machine-learning/index.html | 43 +-
project-components/open-data-models/index.html | 47 +-
.../suspicious-connects-analysis/index.html | 464 +++++++++++++++++++
project-components/visualization/index.html | 69 +--
10 files changed, 1594 insertions(+), 93 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/get-started/architecture/index.html
----------------------------------------------------------------------
diff --git a/get-started/architecture/index.html b/get-started/architecture/index.html
new file mode 100755
index 0000000..23ecbd6
--- /dev/null
+++ b/get-started/architecture/index.html
@@ -0,0 +1,181 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Architecture - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li class="active"><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+
+ <h1>Architecture</h1>
+
+ <hr />
+
+ <p class="center">
+ <img src="../../library/images/architecture.png" alt="Product Architechture" />
+ </p>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/get-started/demo/index.html
----------------------------------------------------------------------
diff --git a/get-started/demo/index.html b/get-started/demo/index.html
new file mode 100755
index 0000000..f34c54c
--- /dev/null
+++ b/get-started/demo/index.html
@@ -0,0 +1,184 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Demo - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li class="active"><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+
+ <h1>Demo</h1>
+
+ <hr />
+
+ <ol style="margin-bottom:50px;">
+ <li><a href="https://docs.docker.com/engine/installation/" target="_blank">Install Docker</a> for your platform</li>
+ <li>Run the container: docker run -it -p 8889:8889 apachespot/spot-demo</li>
+ <li>Visit <a href="http://localhost:8889/files/ui/flow/suspicious.html#date=2016-07-08" target="_blank">http://localhost:8889/files/ui/flow/suspicious.html#date=2016-07-08</a> in your browser to get started. For the full instructions visit the <a href="https://hub.docker.com/r/apachespot/spot-demo/" target="_blank">spot</a> on Docker hub</li>
+
+ </ol>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/get-started/environment/index.html
----------------------------------------------------------------------
diff --git a/get-started/environment/index.html b/get-started/environment/index.html
new file mode 100755
index 0000000..4d9e965
--- /dev/null
+++ b/get-started/environment/index.html
@@ -0,0 +1,189 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Environment - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li class="active"><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+
+ <h1>Environment</h1>
+
+ <hr />
+
+ <h2>Pure Hadoop</h2>
+
+ <p>Apache Spot (incubating) can be installed on a new or existing Hadoop cluster, its components viewed as services and distributed according to common roles in the cluster. One approach is to follow the community validated deployment of CDH (see diagram below).</p>
+
+ <p>This approach is recommended for customers with a dedicated cluster for use of the solution or a security data lake; it takes advantage of existing investment in hardware and software. The disadvantage of this approach is that it does require the installation of software on Hadoop nodes not managed by systems like Cloudera Manager.</p>
+
+ <p class="center"><a href="../../library/images/service-layout.png"><img src="../../library/images/service-layout-sm.png" alt="Service Layout" /></a></p>
+
+ <p>In the Pure Hadoop deployment scenario, the ingest component runs on an edge node, which is an expected use of this role. It is required to install some non-Hadoop software to make ingest component work. The Operational Analytics runs on a node intended for browser-based management and user applications, so that all user interfaces are located on a node or nodes with the same role. The Machine Learning (ML) component is installed on worker nodes, as the resource management for an ML pipeline is similar for functions inside and outside Hadoop.</p>
+
+ <p>Although both of these deployment options are validated and supported, additional scenarios that combine these approaches are certainly.</p>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/get-started/index.html
----------------------------------------------------------------------
diff --git a/get-started/index.html b/get-started/index.html
new file mode 100755
index 0000000..2633e5d
--- /dev/null
+++ b/get-started/index.html
@@ -0,0 +1,227 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Get Started - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li class="active"><a href="../get-started">Get Started</a></li>
+ <li><a href="../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../get-started/environment">Environment</a></li>
+ <li><a href="../get-started/architecture">Architecture</a></li>
+ <li><a href="../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../community/committers">Project Committers</a></li>
+ <li><a href="../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+
+ <h1>Getting Started</h1>
+ <hr />
+ <h2>Apache Spot (Incubating)</h2>
+
+ <p>Apache Spot is open source software for leveraging insights from flow and packet analysis. It helps enterprises and service providers gain insight on their network environments through transparency of service delivery and identification of potential security threats or attacks happening among resources operating at cloud scale. While current threat intelligence tools help, identifying unknown threats and attacks remains a challenge. Apache Spot provides tools to accelerate companies’ ability to expose suspicious connections and previously unseen attacks using flow and packet analysis technologies.</p>
+
+ <p>Apache Spot (incubating) is a solution built to leverage strong technology in both "big data" and scientific computing disciplines. While the solution solves problems end-to-end, components may be leveraged individually or integrated into other solutions. All components can output data in CSV format, maximizing interoperability.</p>
+
+ <h2>Overview</h2>
+
+ <p>With the arrival of big data platforms, security organizations can now make data-driven decisions about how they protect their assets. Records of network traffic, captured as network flows, are often stored and analyzed for use in network management. An organization can use this same information to gain insight into what channels corporate information flows through.</p>
+
+ <p>By taking into account additional context such as prevalent attacks and key protocols to the organization, the security team can develop a strategy that applies the right amount of per-channel risk mitigation based on the value of the data flowing through it. For an organization, we call this "the port perspective".</p>
+
+ <p>There are two vectors that all organizations should evaluate:</p>
+
+ <ul>
+ <li>A "wide enough, deep enough" protection strategy that involves both edge prevention and sophisticated detection of unusual behavior</li>
+ <li>A deep inspection of key protocols using methods that can scale to the volume of data flowing across that channel</li>
+ </ul>
+
+ <p>While inspecting specific, unique flows of data that may be important for individual organizations, all organizations can realize significant risk reduction from analysis of network flows and DNS (domain name service) replies.</p>
+
+ <p>Apache Spot by leveraging strong technology in both Big Data and Scientific Computing disciplines is a solution intended to support this strategy by focusing on “hard security problems” detecting events such as lateral movement, side-channel data escapes, insider issues, or stealthy behavior in general.</p>
+
+ <p style="text-align:center;margin:35px 0;"><img src="../library/images/how-it-works.png" alt="" /></p>
+
+ <h3>Telemetry</h3>
+ <ul>
+ <li>Flows.</li>
+ <li>DNS (pcaps).</li>
+ <li>Proxy.</li>
+ </ul>
+
+ <h3>Parallel Ingest Framework</h3>
+ <ul>
+ <li>Open source decoders.</li>
+ <li>Load data in Hadoop.</li>
+ <li>Data transformation.</li>
+ </ul>
+
+ <h3>Machine Learning</h3>
+ <ul>
+ <li>Filter billion of events to a few thousands.</li>
+ <li>Unsupervised learning.</li>
+ </ul>
+
+ <h3>Operational Analytics</h3>
+ <ul style="margin-bottom:50px;">
+ <li>Visualization.</li>
+ <li>Attack heuristics.</li>
+ <li>Noise filter.</li>
+ </ul>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/get-started/supporting-apache/index.html
----------------------------------------------------------------------
diff --git a/get-started/supporting-apache/index.html b/get-started/supporting-apache/index.html
new file mode 100755
index 0000000..5ca3f2d
--- /dev/null
+++ b/get-started/supporting-apache/index.html
@@ -0,0 +1,222 @@
+<!doctype html>
+
+<!--[if lt IE 7]><html lang="en-US" class="no-js lt-ie9 lt-ie8 lt-ie7"><![endif]-->
+<!--[if (IE 7)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9 lt-ie8"><![endif]-->
+<!--[if (IE 8)&!(IEMobile)]><html lang="en-US" class="no-js lt-ie9"><![endif]-->
+<!--[if gt IE 8]><!-->
+<html lang="en-US" class="no-js">
+ <!--<![endif]-->
+
+ <head>
+ <meta charset="utf-8">
+
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+
+ <title>Supporting Apache - Apache Spot</title>
+
+ <meta name="HandheldFriendly" content="True">
+ <meta name="MobileOptimized" content="320">
+ <meta name="viewport" content="width=device-width, initial-scale=1"/>
+
+ <link rel="apple-touch-icon" href="../../library/images/apple-touch-icon.png">
+ <link rel="icon" href="../../favicon.png">
+ <!--[if IE]>
+ <link rel="shortcut icon" href="http://spot.incubator.apache.org/favicon.ico">
+ <![endif]-->
+ <meta name="msapplication-TileColor" content="#f01d4f">
+ <meta name="msapplication-TileImage" content="../../library/images/win8-tile-icon.png">
+ <meta name="theme-color" content="#121212">
+
+ <link rel='dns-prefetch' href='//fonts.googleapis.com' />
+ <link rel='dns-prefetch' href='//s.w.org' />
+ <link rel="alternate" type="application/rss+xml" title="Apache Spot » Feed" href="../../feed/" />
+
+ <link rel='stylesheet' id='googleFonts-css' href='http://fonts.googleapis.com/css?family=Lato%3A400%2C700%2C400italic%2C700italic' type='text/css' media='all' />
+ <link rel='stylesheet' id='bones-stylesheet-css' href='../../library/css/style.css' type='text/css' media='all' />
+ <!--[if lt IE 9]>
+ <link rel='stylesheet' id='bones-ie-only-css' href='http://spot.incubator.apache.org/library/css/ie.css' type='text/css' media='all' />
+ <![endif]-->
+ <link rel='stylesheet' id='mm-css-css' href='../../library/css/meanmenu.css' type='text/css' media='all' />
+ <script type='text/javascript' src='../../library/js/libs/modernizr.custom.min.js'></script>
+ <script src="https://ajax.googleapis.com/ajax/libs/jquery/3.1.1/jquery.min.js"></script>
+ <script type='text/javascript' src='../../library/js/jquery-migrate.min.js'></script>
+ <script type='text/javascript' src='../../library/js/jquery.meanmenu.js'></script>
+
+ <script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-87470508-1', 'auto');
+ ga('send', 'pageview');
+
+ </script>
+ </head>
+
+ <body class="page">
+
+ <div id="container">
+ <header class="header">
+
+ <div id="inner-header" class="wrap cf">
+
+ <p id="logo" class="h1" itemscope itemtype="http://schema.org/Organization">
+ <a href="http://spot.incubator.apache.org/" rel="nofollow"><img src="../../library/images/logo.png" alt="Apache Spot" /></a>
+ </p>
+
+ <nav>
+ <ul id="menu-main-menu" class="nav top-nav cf">
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129 menu-item-has-children active">
+ <a target="_blank" href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li class="active"><a href="../../get-started/supporting-apache/">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
+ <a href="../../download">GitHub</a>
+ </li>
+ <li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
+ <a href="../../community">Community</a>
+ <ul class="sub-menu com-sm">
+ <li class="dropmenu-head">Get in Touch</li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
+ <li class="divider"></li>
+ <li><a href="../../community/committers">Project Committers</a></li>
+ <li><a href="../../community/contribute">How to Contribute</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Developer Resources</li>
+ <li><a href="https://github.com/apache/incubator-spot" target="_blank" class="github">Github</a></li>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT/" target="_blank" class="jira">JIRA Issue Tracker</a></li>
+ <li class="divider"></li>
+ <li class="dropmenu-head">Social Media</li>
+ <li><a href="https://twitter.com/ApacheSpot" target="_blank" class="twitter-icon">Twitter</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-106" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-106">
+ <a href="../../doc">Documentation</a>
+ </li>
+ <li class="menu-item menu-item-has-children">
+ <a href="#">Project Components</a>
+ <ul class="sub-menu">
+ <li><a href="../../project-components/ingestion">Ingestion</a></li>
+ <li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
+ <li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
+ </ul>
+ </li>
+ <li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
+ <a href="../../blog">Blog</a>
+ </li>
+ </ul>
+ </nav>
+
+ </div>
+
+ </header>
+
+ <div id="mobile-nav"></div>
+
+ <div id="content">
+
+ <div class="wrap cf">
+
+ <h1>Supporting Apache</h1>
+ <hr />
+ <p>Apache Spot functionality is divided into different modules, go to each module for developer documentation:</p>
+ <ul>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-ingest/README.md" target="_blank">spot-ingest</a></li>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-ml/README.md" target="_blank">spot-ml</a></li>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-oa/README.md" target="_blank">spot-oa</a></li>
+ <li><a href="https://github.com/apache/incubator-spot/blob/master/spot-setup/README.md" target="_blank">spot-setup</a></li>
+ </ul>
+
+ <h2>Community Support</h2>
+ <p>Our Central repository for our Apache Spot solution is found here. If you find a bug, have question or something to discuss please contact us:</p>
+ <ul>
+ <li><a href="https://issues.apache.org/jira/browse/SPOT-20?jql=project%20%3D%20SPOT" target="_blank">Create an Issue.</a></li>
+ <li>Community Access.</li>
+ </ul>
+
+ <h2>Contributing to Apache Spot</h2>
+ <p>Help us improve Apache Spot!</p>
+ <p>Apache Spot is Apache 2.0 licensed and accepts contributions via GitHub pull requests. Please follow the next steps and join our community. Disconnected</p>
+ <ul>
+ <li>Create an Issue.</li>
+ <li>Community Access.</li>
+ </ul>
+
+ <h2>Contributing to Apache Spot code</h2>
+
+ <ul>
+ <li>Fork the repo of the module that you wish to commit to.</li>
+ <li>Create a Branch, we use <a href="https://git-scm.com/book/en/v2/Git-Branching-Branching-Workflows#Topic-Branches" target="_blank">topic branches</a> for our commits.</li>
+ <li>Push your commit(s) to your repository.</li>
+ <li>Create a pull request to the original repo in Apache Spot organization.</li>
+ </ul>
+
+ <h2>Commit Guidelines</h2>
+ <ul>
+ <li>Bug fixes should be a single commit.</li>
+ <li>Please be clear with the commit messages about what you are fixing or adding to the code base. If you code is addressing an open issue please add the reference to the issue in the comments with: Fix: Issue's URL.</li>
+ </ul>
+
+ <h2>Merge approval</h2>
+ <p>Apache Spot maintainers use +1 in a comment on the code review to indicate acceptance, at least 3 "+1" from maintainers are required to approve the merge. If you have any question or concern please feel free to add a comment in your pull request or branch and tag any of the maintainers.</p>
+
+ <h2>Licensing</h2>
+ <p>Apache Spot is licensed under the Apache License, Version 2.0. See <a href="https://github.com/apache/incubator-spot/blob/master/LICENSE" target="_blank">LICENSE</a> for the full license text.</p>
+ <ul style="margin-bottom:50px;">
+ <li>spot-nfdump <a href="https://github.com/Open-Network-Insight/spot-nfdump/blob/master/BSD-license.txt" target="_blank">License</a></li>
+ </ul>
+
+ </div><!--/.wrap-->
+
+ </div><!--/#content-->
+
+ <div id="more-info">
+ <div class="wrap cf">
+
+ <p>
+ <a href="https://github.com/apache/incubator-spot" class="y-btn" target="_blank">More Info</a>
+ </p>
+
+ <p style="margin-top:50px;"><img src="../../library/images/apache-incubator.png" alt="Apache Incubator" />
+ </p>
+
+ <p class="disclaimer">
+ Apache Spot is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.
+ </p>
+
+ <p class="disclaimer">
+ The contents of this website are © 2016 Apache Software Foundation under the terms of the Apache License v2. Apache Spot and its logo are trademarks of the Apache Software Foundation.
+ </p>
+ </div>
+ </div>
+
+ <footer class="footer" role="contentinfo" itemscope itemtype="http://schema.org/WPFooter">
+
+ <div id="inner-footer" class="wrap cf">
+
+ <p class="source-org copyright" style="text-align:center;">
+ © 2016 Apache Spot.
+ </p>
+
+ </div>
+
+ </footer>
+
+ </div>
+ <a href="#0" class="cd-top">Top</a>
+ <script type='text/javascript' src='../../library/js/scripts.js'></script>
+
+ </body>
+
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/project-components/ingestion/index.html
----------------------------------------------------------------------
diff --git a/project-components/ingestion/index.html b/project-components/ingestion/index.html
index 6949f4c..cde346f 100755
--- a/project-components/ingestion/index.html
+++ b/project-components/ingestion/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li class="active"><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -124,50 +133,50 @@
</div>
</div>-->
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Apache Spot Ingestion</h1>
-
+
<p>Apache Spot overcomes the challenge of how to enhance data collection from different sources when most of the time our collectors are sending thousands of events per second overflowing available server resources (CPU, memory). With Spot, you can ensure service availability near to 100% without losing data. Spot enables a faster, scalable and distributed service when required. Because of its distributed architecture, data loss does not occur when data queuing on the data node that is executing the collector daemon when peak workloads crashes the process. This architecture ensures availability near 99.99999%, without losing information in the effort.</p>
-
+
<p><img src="../../library/images/ingestion.png" alt="" /></p>
-
+
<h3>Inside the Ingest</h3>
-
+
<h4><em>Spot-Collectors</em></h4>
-
+
<p>Daemons running in the background monitor/collect from file system paths. Collectors detect new files generated by network tools or data generated previously and left in the path for its collection. Collectors then translate this data into a human-readable format by using dissection tools, such as nfdump and tshark.</p>
-
+
<p>Once the data is transformed, collectors store the data in HDFS with the original format (for forensics) and in Hive, in Avro-parquet format, so the data can be accessible by SQL queries.</p>
<p>Once a file has been uploaded there two paths are available.</p>
-
+
<ol>
<li>Data size > 1mb: File name and location in HDFS is sent to Kafka.</li>
<li>Data size < 1mb: the data event is sent to Kafka to be processed with Spark Streaming.</li>
</ol>
-
+
<h4><em>Kafka</em></h4>
-
+
<p>A new topic is created for each instance of the ingest process. Partitions are defined by the number of Spot Workers in the ingest. Kafka stores data sent by the collectors, so the Spot Workers can parse the data.</p>
-
+
<h4><em>Spot Workers</em></h4>
-
+
<p>Just like the collectors, Spot Workers are daemons running in the background subscribed to a specific Kafka topic and partition. The Spot Workers read, parse and store the data in a specific Hive tables that will be consumed by the machine learning algorithm later.</p>
-
+
<p>Currently there are two types of Spot Workers.</p>
-
+
<ol>
<li>Python workers use multithreading to process data with the defined parsers.</li>
<li>Spark-Streaming workers execute a Spark application to read data from Kafka, using spark-streaming context (micro batching).</li>
- </ol>
-
+ </ol>
+
</div>
</div>
-
+
</div>
@@ -209,4 +218,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/project-components/machine-learning/index.html
----------------------------------------------------------------------
diff --git a/project-components/machine-learning/index.html b/project-components/machine-learning/index.html
index 72c8d01..1047947 100755
--- a/project-components/machine-learning/index.html
+++ b/project-components/machine-learning/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li class="active"><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -124,28 +133,26 @@
</div>
</div>-->
-
+
<div id="content">
-
+
<div class="wrap cf"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Apache Spot Machine Learning</h1>
-
+
<p>The machine learning component of Apache Spot contains routines for performing suspicious connections analyses on netflow, DNS or proxy logs gathered from a network. These analyses consume a collection of network events and produce a list of the events that are considered to be the least probable, and these are consider the most suspicious. They rely on the ingest component of Spot to collect and load netflow, DNS, and proxy records.</p>
-
+
<p>Apache Spot uses topic modeling to discover normal and abnormal behavior. It treats the collection of logs related to an IP as a document and uses Latent Dirichlet Allocation (LDA) to discover hidden semantic structures in the collection of such documents. </p>
-
+
<p>LDA is a generative probabilistic model used for discrete data, such as text corpora. LDA is a three-level Bayesian model in which each word of a document is generated from a mixture of an underlying set of topics [1]. We apply LDA to network traffic by converting network log entries into words through aggregation and discretization. In this manner, documents correspond to IP addresses, words to log entries (related to an IP address) and topics to profiles of common network activity.</p>
-
- <p><img src="../../library/images/machine-learning.png" alt="" /></p>
-
+
<p>Apache Spot infers a probabilistic model for the network behavior of each IP address. Each network log entry is assigned an estimated probability (score) by the model. The events with lower scores are flagged as “suspicious” for further analysis.</p>
<p class="citation">[1] Blei, David M., Andrew Y. Ng, and Michael I. Jordan. "Latent dirichlet allocation." Journal of machine Learning research 3, no. Jan (2003): 993-1022.</p>
</div>
-
+
</div>
-
+
</div>
@@ -187,4 +194,4 @@
</body>
-</html>
\ No newline at end of file
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-spot/blob/bc57d11d/project-components/open-data-models/index.html
----------------------------------------------------------------------
diff --git a/project-components/open-data-models/index.html b/project-components/open-data-models/index.html
index 7c4ac19..e93d8b4 100755
--- a/project-components/open-data-models/index.html
+++ b/project-components/open-data-models/index.html
@@ -47,10 +47,10 @@
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
+
ga('create', 'UA-87470508-1', 'auto');
ga('send', 'pageview');
-
+
</script>
</head>
@@ -67,17 +67,24 @@
<nav>
<ul id="menu-main-menu" class="nav top-nav cf">
- <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
- <a target="_blank" href="https://github.com/apache/incubator-spot#try-the-apache-spot-ui-with-example-data">Get Started</a>
+ <li id="menu-item-129" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-129">
+ <a href="../../get-started">Get Started</a>
+ <ul class="sub-menu">
+ <li><a href="../../get-started">Get Started</a></li>
+ <li><a href="../../get-started/supporting-apache">Supporting Apache</a></li>
+ <li><a href="../../get-started/environment">Environment</a></li>
+ <li><a href="../../get-started/architecture">Architecture</a></li>
+ <li><a href="../../get-started/demo">Demo</a></li>
+ </ul>
</li>
<li id="menu-item-5" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-5">
- <a target="_blank" href="https://github.com/apache/incubator-spot.git">GitHub</a>
+ <a href="../../download">GitHub</a>
</li>
<li id="menu-item-130" class="menu-item menu-item-type-custom menu-item-object-custom menu-item-130">
<a href="../../community">Community</a>
<ul class="sub-menu com-sm">
<li class="dropmenu-head">Get in Touch</li>
- <li><a href="../../community" class="mail">Mailing Lists</a></li>
+ <li><a href="../../community" class="mail">Mailing Lists</a></li>
<li><a href="http://slack.apache-spot.io/" target="_blank" class="slack">Slack Channel</a></li>
<li class="divider"></li>
<li><a href="../../community/committers">Project Committers</a></li>
@@ -97,10 +104,12 @@
<li class="menu-item menu-item-has-children active">
<a href="#">Project Components</a>
<ul class="sub-menu">
- <li class="active"><a href="../../project-components/open-data-models">Open Data Models</a></li>
<li><a href="../../project-components/ingestion">Ingestion</a></li>
<li><a href="../../project-components/machine-learning">Machine Learning</a></li>
+ <li><a href="../../project-components/suspicious-connects-analysis">Suspicous Connects Analysis</a></li>
<li><a href="../../project-components/visualization">Visualization</a></li>
+ <li class="under-dev">Under Development</li>
+ <li class="active"><a href="../../project-components/open-data-models">Open Data Models</a></li>
</ul>
</li>
<li id="menu-item-13" class="menu-item menu-item-type-post_type menu-item-object-page menu-item-13">
@@ -115,19 +124,19 @@
<div id="mobile-nav"></div>
-
+
<div id="content">
-
+
<div class="wrap cf with-sidebar"><!--if page has sidebar, add class "with-sidebar"-->
<div class="main">
<h1 class="page-title">Apache Spot Open Data Model</h1>
-
+
<p>Many organizations have built threat detection capabilities leveraging myriad vendor solutions. This approach leads to many silos of data corresponding to each vendor and often results in storing multiple copies of the same data, as each vendor’s capability operates independently from the others. There is no single vendor able to cost-effectively store and analyze all the data required to detect threats and facilitate incident investigations and remediation.</p>
-
+
<p>Apache Spot ODM brings together all security-related data (event, user, network, endpoint, etc.) into a singular view that can be used to detect threats more effectively than ever before. This consolidated view can be leveraged to create new analytic models that were not previously possible and to provide needed context at the event level to effectively determine whether or not there is a threat. The Apache Spot ODM enables the sharing and reuse of threat detection models, algorithms and analytics, because of a shared, open data model.</p>
-
+
<p>The open data model (ODM) provides a common taxonomy for describing security telemetry data used to detect threats. It uses schemas, data structures, file formats and configurations in the underlying CDH platform for collecting, storing and analyzing security telemetry data at scale. Spot defines relationships amongst the various security data types for joining log data with user, network and endpoint entity data.</p>
-
+
<p>The Apache Spot ODM enables organizations to:</p>
<ul>
<li>Store one copy of the security telemetry data and apply UNLIMITED analytics
@@ -135,7 +144,7 @@
<li>Leverage out-of-the-box analytics powered by machine learning to detect threats in DNS, Flow and Proxy data</li>
<li>Build custom analytics to your desired specification</li>
<li>Plug-in third-party vendor analytics that interoperate with the ODM</li>
- </ul>
+ </ul>
</li>
<li>Share and/or reuse threat detection models, algorithms, ingest pipelines, visualizations and analytics across the Apache Spot community, due to a common data model.</li>
<li>Leverage all your security telemetry data to establish the context needed to better detect threats
@@ -143,15 +152,15 @@
<li>Security logs</li>
<li>User, endpoint and network entity data</li>
<li>Threat intelligence data</li>
- </ul>
+ </ul>
</li>
<li>Avoid “lock-in” to a specific technology and gain needed analytic flexibility resultant from a shared, open data model.</li>
</ul>
</div>
-
-
+
+
</div>
-
+
</div>
<div id="more-info">
@@ -192,4 +201,4 @@
</body>
-</html>
\ No newline at end of file
+</html>