You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@fluo.apache.org by mw...@apache.org on 2016/10/14 18:49:59 UTC
[6/6] incubator-fluo-website git commit: Jekyll build from
gh-pages:05f7bf0
Jekyll build from gh-pages:05f7bf0
Major refactoring of release posts
* Combined all posts about each release into one
* The 'release-notes' category no longer exists
* Removed all 'blog' posts about releases.
* The blog archive nows shows all releases and was renamed news.
* Improved download instructions on release page and include source
release
* Made all posts use UTC
* Made the /download/ page redirect to latest Fluo release post
Project: http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/commit/5576766a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/tree/5576766a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/diff/5576766a
Branch: refs/heads/asf-site
Commit: 5576766a7266d232b2552349be429f5946fc1eb9
Parents: ebd1f59
Author: Mike Walch <mw...@apache.org>
Authored: Fri Oct 14 14:48:15 2016 -0400
Committer: Mike Walch <mw...@apache.org>
Committed: Fri Oct 14 14:48:15 2016 -0400
----------------------------------------------------------------------
1.0.0-alpha-1-release-notes/index.html | 8 +-
1.0.0-alpha-1-release/index.html | 8 +-
1.0.0-beta-1-release-notes/index.html | 8 +-
1.0.0-beta-1-release/index.html | 8 +-
1.0.0-beta-2-release-notes/index.html | 8 +-
1.0.0-beta-2-release/index.html | 8 +-
404.html | 4 +-
README.md | 4 +-
apidocs/archive/index.html | 4 +-
apidocs/fluo-recipes/index.html | 8 +-
apidocs/fluo/index.html | 8 +-
apidocs/index.html | 4 +-
beta-2-pre-release-stress-test/index.html | 8 +-
.../fluo-1.0.0-alpha-1-is-released/index.html | 124 ----
blog/2014/12/30/stress-test-long-run/index.html | 6 +-
.../22/fluo-talk-at-accumulo-summit/index.html | 6 +-
.../09/fluo-1.0.0-beta-1-is-released/index.html | 129 ----
.../beta-2-pre-release-stress-test/index.html | 8 +-
blog/2016/01/10/webindex-long-run/index.html | 314 ---------
blog/2016/01/11/webindex-long-run/index.html | 314 +++++++++
.../12/fluo-1.0.0-beta-2-is-released/index.html | 141 ----
blog/2016/05/17/webindex-long-run-2/index.html | 12 +-
.../2016/06/02/fluo-moving-to-apache/index.html | 6 +-
.../27/1.0.0-incubating-is-released/index.html | 120 ----
blog/index.html | 175 +----
docs/1.0.0-alpha-1/index.html | 8 +-
docs/1.0.0-beta-1/index.html | 8 +-
docs/1.0.0-beta-2/index.html | 8 +-
docs/archive/index.html | 4 +-
docs/fluo-recipes/1.0.0-beta-1/cfm/index.html | 4 +-
.../1.0.0-beta-1/export-queue/index.html | 4 +-
docs/fluo-recipes/1.0.0-beta-1/index.html | 4 +-
.../1.0.0-beta-1/recording-tx/index.html | 4 +-
.../1.0.0-beta-1/serialization/index.html | 4 +-
.../1.0.0-beta-1/table-optimization/index.html | 4 +-
.../1.0.0-beta-1/transient/index.html | 4 +-
.../1.0.0-beta-2/accumulo-export/index.html | 4 +-
docs/fluo-recipes/1.0.0-beta-2/cfm/index.html | 4 +-
.../1.0.0-beta-2/export-queue/index.html | 4 +-
docs/fluo-recipes/1.0.0-beta-2/index.html | 4 +-
.../1.0.0-beta-2/recording-tx/index.html | 4 +-
.../1.0.0-beta-2/row-hasher/index.html | 4 +-
.../1.0.0-beta-2/serialization/index.html | 4 +-
.../1.0.0-beta-2/table-optimization/index.html | 4 +-
.../1.0.0-beta-2/testing/index.html | 4 +-
.../1.0.0-beta-2/transient/index.html | 4 +-
docs/fluo-recipes/index.html | 8 +-
docs/fluo/1.0.0-alpha-1/index.html | 4 +-
docs/fluo/1.0.0-alpha-1/stress/index.html | 4 +-
docs/fluo/1.0.0-beta-1/applications/index.html | 6 +-
docs/fluo/1.0.0-beta-1/architecture/index.html | 4 +-
docs/fluo/1.0.0-beta-1/contributing/index.html | 4 +-
docs/fluo/1.0.0-beta-1/index.html | 7 +-
docs/fluo/1.0.0-beta-1/metrics/index.html | 4 +-
.../1.0.0-beta-1/mini-fluo-setup/index.html | 4 +-
.../1.0.0-beta-1/prod-fluo-setup/index.html | 4 +-
docs/fluo/1.0.0-beta-2/applications/index.html | 6 +-
docs/fluo/1.0.0-beta-2/architecture/index.html | 4 +-
docs/fluo/1.0.0-beta-2/contributing/index.html | 4 +-
docs/fluo/1.0.0-beta-2/grafana/index.html | 4 +-
docs/fluo/1.0.0-beta-2/index.html | 7 +-
docs/fluo/1.0.0-beta-2/metrics/index.html | 4 +-
.../1.0.0-beta-2/mini-fluo-setup/index.html | 4 +-
.../1.0.0-beta-2/prod-fluo-setup/index.html | 4 +-
.../1.0.0-incubating/applications/index.html | 4 +-
.../1.0.0-incubating/architecture/index.html | 4 +-
.../1.0.0-incubating/contributing/index.html | 4 +-
docs/fluo/1.0.0-incubating/grafana/index.html | 4 +-
docs/fluo/1.0.0-incubating/index.html | 4 +-
docs/fluo/1.0.0-incubating/install/index.html | 4 +-
docs/fluo/1.0.0-incubating/metrics/index.html | 4 +-
docs/fluo/index.html | 8 +-
docs/index.html | 4 +-
download/index.html | 126 +---
feed.xml | 635 +++++++++++++++----
fluo-1.0.0-alpha-1-is-released/index.html | 10 -
fluo-1.0.0-beta-1-is-released/index.html | 10 -
fluo-1.0.0-beta-2-is-released/index.html | 10 -
fluo-talk-at-accumulo-summit/index.html | 8 +-
getinvolved/index.html | 6 +-
how-to-contribute/index.html | 4 +-
index.html | 12 +-
news/index.html | 189 ++++++
people/index.html | 4 +-
poweredby/index.html | 4 +-
pre-asf-download/index.html | 4 +-
pre-asf-release/index.html | 10 +-
related-projects/index.html | 4 +-
release-notes/1.0.0-alpha-1/index.html | 10 +
release-notes/fluo-1.0.0-alpha-1/index.html | 308 ---------
release-notes/fluo-1.0.0-beta-1/index.html | 251 +-------
release-notes/fluo-1.0.0-beta-2/index.html | 232 +------
release-notes/fluo-1.0.0-incubating/index.html | 207 ------
release-notes/index.html | 136 ----
release-process/index.html | 4 +-
release/fluo-1.0.0-alpha-1/index.html | 207 +++++-
release/fluo-1.0.0-beta-1/index.html | 151 ++++-
release/fluo-1.0.0-beta-2/index.html | 149 ++++-
release/fluo-1.0.0-incubating/index.html | 119 +++-
release/fluo-recipes-1.0.0-beta-1/index.html | 10 +-
release/fluo-recipes-1.0.0-beta-2/index.html | 10 +-
release/index.html | 6 +-
resources/release-notes/1.0.0-beta-1/queued.png | Bin 23034 -> 0 bytes
resources/release-notes/1.0.0-beta-1/rate.png | Bin 25764 -> 0 bytes
resources/release/1.0.0-beta-1/queued.png | Bin 0 -> 23034 bytes
resources/release/1.0.0-beta-1/rate.png | Bin 0 -> 25764 bytes
stress-test-long-run/index.html | 8 +-
tour/application-configuration/index.html | 4 +-
tour/architecture/index.html | 4 +-
tour/basic-read-write/index.html | 4 +-
tour/collision-code/index.html | 4 +-
tour/collisions/index.html | 4 +-
tour/data-model/index.html | 4 +-
tour/data-pojos/index.html | 4 +-
tour/exercise-1/index.html | 4 +-
tour/index.html | 4 +-
tour/loader-executer/index.html | 4 +-
tour/mem-self-ntfy-code/index.html | 4 +-
tour/mem-self-ntfy/index.html | 4 +-
tour/multi-get/index.html | 4 +-
tour/observer_example/index.html | 4 +-
tour/observers/index.html | 4 +-
tour/recipes/index.html | 4 +-
tour/row-locking/index.html | 4 +-
tour/scanning-code/index.html | 4 +-
tour/scanning/index.html | 4 +-
tour/snapshot-isolation-code/index.html | 4 +-
tour/snapshot-isolation/index.html | 4 +-
tour/tx-logging/index.html | 4 +-
tour/weak-code/index.html | 4 +-
tour/weak-notifications/index.html | 4 +-
tour/write-skew-code/index.html | 4 +-
tour/write-skew/index.html | 4 +-
tour/writing-code/index.html | 4 +-
webindex-long-run/index.html | 8 +-
135 files changed, 1896 insertions(+), 2729 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/1.0.0-alpha-1-release-notes/index.html
----------------------------------------------------------------------
diff --git a/1.0.0-alpha-1-release-notes/index.html b/1.0.0-alpha-1-release-notes/index.html
index 7d18826..a6cc802 100644
--- a/1.0.0-alpha-1-release-notes/index.html
+++ b/1.0.0-alpha-1-release-notes/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/release-notes/fluo-1.0.0-alpha-1/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/release-notes/fluo-1.0.0-alpha-1/">
+<link rel="canonical" href="https://fluo.apache.org/release/fluo-1.0.0-alpha-1/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/release/fluo-1.0.0-alpha-1/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/release-notes/fluo-1.0.0-alpha-1/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/release-notes/fluo-1.0.0-alpha-1/"</script>
+<a href="https://fluo.apache.org/release/fluo-1.0.0-alpha-1/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/release/fluo-1.0.0-alpha-1/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/1.0.0-alpha-1-release/index.html
----------------------------------------------------------------------
diff --git a/1.0.0-alpha-1-release/index.html b/1.0.0-alpha-1-release/index.html
index 388a09f..a6cc802 100644
--- a/1.0.0-alpha-1-release/index.html
+++ b/1.0.0-alpha-1-release/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/release/fluo-1.0.0-alpha-1/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/release/fluo-1.0.0-alpha-1/">
+<link rel="canonical" href="https://fluo.apache.org/release/fluo-1.0.0-alpha-1/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/release/fluo-1.0.0-alpha-1/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/release/fluo-1.0.0-alpha-1/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/release/fluo-1.0.0-alpha-1/"</script>
+<a href="https://fluo.apache.org/release/fluo-1.0.0-alpha-1/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/release/fluo-1.0.0-alpha-1/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/1.0.0-beta-1-release-notes/index.html
----------------------------------------------------------------------
diff --git a/1.0.0-beta-1-release-notes/index.html b/1.0.0-beta-1-release-notes/index.html
index 792f133..5a2c8a7 100644
--- a/1.0.0-beta-1-release-notes/index.html
+++ b/1.0.0-beta-1-release-notes/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/release-notes/fluo-1.0.0-beta-1/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/release-notes/fluo-1.0.0-beta-1/">
+<link rel="canonical" href="https://fluo.apache.org/release/fluo-1.0.0-beta-1/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/release/fluo-1.0.0-beta-1/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/release-notes/fluo-1.0.0-beta-1/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/release-notes/fluo-1.0.0-beta-1/"</script>
+<a href="https://fluo.apache.org/release/fluo-1.0.0-beta-1/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/release/fluo-1.0.0-beta-1/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/1.0.0-beta-1-release/index.html
----------------------------------------------------------------------
diff --git a/1.0.0-beta-1-release/index.html b/1.0.0-beta-1-release/index.html
index 29f8f56..5a2c8a7 100644
--- a/1.0.0-beta-1-release/index.html
+++ b/1.0.0-beta-1-release/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/release/fluo-1.0.0-beta-1/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/release/fluo-1.0.0-beta-1/">
+<link rel="canonical" href="https://fluo.apache.org/release/fluo-1.0.0-beta-1/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/release/fluo-1.0.0-beta-1/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/release/fluo-1.0.0-beta-1/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/release/fluo-1.0.0-beta-1/"</script>
+<a href="https://fluo.apache.org/release/fluo-1.0.0-beta-1/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/release/fluo-1.0.0-beta-1/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/1.0.0-beta-2-release-notes/index.html
----------------------------------------------------------------------
diff --git a/1.0.0-beta-2-release-notes/index.html b/1.0.0-beta-2-release-notes/index.html
index 601f852..f5deab1 100644
--- a/1.0.0-beta-2-release-notes/index.html
+++ b/1.0.0-beta-2-release-notes/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/release-notes/fluo-1.0.0-beta-2/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/release-notes/fluo-1.0.0-beta-2/">
+<link rel="canonical" href="https://fluo.apache.org/release/fluo-1.0.0-beta-2/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/release/fluo-1.0.0-beta-2/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/release-notes/fluo-1.0.0-beta-2/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/release-notes/fluo-1.0.0-beta-2/"</script>
+<a href="https://fluo.apache.org/release/fluo-1.0.0-beta-2/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/release/fluo-1.0.0-beta-2/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/1.0.0-beta-2-release/index.html
----------------------------------------------------------------------
diff --git a/1.0.0-beta-2-release/index.html b/1.0.0-beta-2-release/index.html
index 7084776..f5deab1 100644
--- a/1.0.0-beta-2-release/index.html
+++ b/1.0.0-beta-2-release/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/release/fluo-1.0.0-beta-2/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/release/fluo-1.0.0-beta-2/">
+<link rel="canonical" href="https://fluo.apache.org/release/fluo-1.0.0-beta-2/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/release/fluo-1.0.0-beta-2/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/release/fluo-1.0.0-beta-2/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/release/fluo-1.0.0-beta-2/"</script>
+<a href="https://fluo.apache.org/release/fluo-1.0.0-beta-2/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/release/fluo-1.0.0-beta-2/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/404.html
----------------------------------------------------------------------
diff --git a/404.html b/404.html
index cde26d4..9ad06ad 100644
--- a/404.html
+++ b/404.html
@@ -8,7 +8,7 @@
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/404.html">
+ <link rel="canonical" href="https://fluo.apache.org//404.html">
<link rel="icon" type="image/png" href="/resources/favicon.png">
<title> Apache Fluo </title>
<!--[if lt IE 9]>
@@ -39,7 +39,7 @@
<a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
<ul class="dropdown-menu">
<li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
+ <li><a href="/news/">News Archive</a></li>
<li><a href="/people/">People</a></li>
<li><a href="/related-projects/">Related Projects</a></li>
<li><a href="/poweredby/">Powered By</a></li>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/README.md
----------------------------------------------------------------------
diff --git a/README.md b/README.md
index f6ede57..f1d2897 100644
--- a/README.md
+++ b/README.md
@@ -44,7 +44,7 @@ Below are the steps required to update the Fluo project website for a new releas
3. Confirm that javadocs are hosted externally and modify `apidocs/index.md` to point to link to them.
-4. Create release-notes, release, and blog post announcing the release in `_posts/`
+4. Create a post in `_posts/release` with release notes and resources to announce release.
## Apache Fluo Recipes releases
@@ -62,7 +62,7 @@ Steps to update website for new Fluo Recipes release:
3. Confirm that javadocs are hosted externally and modify `apidocs/index.md` to point to link to them.
-4. Create release-notes, release, and blog post announcing the release in `_posts/`
+4. Create a post in `_posts/release` with release notes and resources to announce release.
[Jekyll]: http://jekyllrb.com/
[Bundler]: http://bundler.io/
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/apidocs/archive/index.html
----------------------------------------------------------------------
diff --git a/apidocs/archive/index.html b/apidocs/archive/index.html
index 4e574cb..9993b76 100644
--- a/apidocs/archive/index.html
+++ b/apidocs/archive/index.html
@@ -8,7 +8,7 @@
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/apidocs/archive/">
+ <link rel="canonical" href="https://fluo.apache.org//apidocs/archive/">
<link rel="icon" type="image/png" href="/resources/favicon.png">
<title>Pre-ASF API Archive | Apache Fluo</title>
<!--[if lt IE 9]>
@@ -39,7 +39,7 @@
<a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
<ul class="dropdown-menu">
<li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
+ <li><a href="/news/">News Archive</a></li>
<li><a href="/people/">People</a></li>
<li><a href="/related-projects/">Related Projects</a></li>
<li><a href="/poweredby/">Powered By</a></li>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/apidocs/fluo-recipes/index.html
----------------------------------------------------------------------
diff --git a/apidocs/fluo-recipes/index.html b/apidocs/fluo-recipes/index.html
index 3a87f02..49ee601 100644
--- a/apidocs/fluo-recipes/index.html
+++ b/apidocs/fluo-recipes/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/apidocs/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/apidocs/">
+<link rel="canonical" href="https://fluo.apache.org/apidocs/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/apidocs/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/apidocs/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/apidocs/"</script>
+<a href="https://fluo.apache.org/apidocs/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/apidocs/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/apidocs/fluo/index.html
----------------------------------------------------------------------
diff --git a/apidocs/fluo/index.html b/apidocs/fluo/index.html
index 3a87f02..49ee601 100644
--- a/apidocs/fluo/index.html
+++ b/apidocs/fluo/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/apidocs/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/apidocs/">
+<link rel="canonical" href="https://fluo.apache.org/apidocs/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/apidocs/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/apidocs/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/apidocs/"</script>
+<a href="https://fluo.apache.org/apidocs/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/apidocs/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/apidocs/index.html
----------------------------------------------------------------------
diff --git a/apidocs/index.html b/apidocs/index.html
index 76d2257..50b2682 100644
--- a/apidocs/index.html
+++ b/apidocs/index.html
@@ -8,7 +8,7 @@
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/apidocs/">
+ <link rel="canonical" href="https://fluo.apache.org//apidocs/">
<link rel="icon" type="image/png" href="/resources/favicon.png">
<title>API Documentation | Apache Fluo</title>
<!--[if lt IE 9]>
@@ -39,7 +39,7 @@
<a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
<ul class="dropdown-menu">
<li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
+ <li><a href="/news/">News Archive</a></li>
<li><a href="/people/">People</a></li>
<li><a href="/related-projects/">Related Projects</a></li>
<li><a href="/poweredby/">Powered By</a></li>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/beta-2-pre-release-stress-test/index.html
----------------------------------------------------------------------
diff --git a/beta-2-pre-release-stress-test/index.html b/beta-2-pre-release-stress-test/index.html
index 09d35dd..4f94c9b 100644
--- a/beta-2-pre-release-stress-test/index.html
+++ b/beta-2-pre-release-stress-test/index.html
@@ -2,9 +2,9 @@
<html lang="en-US">
<meta charset="utf-8">
<title>Redirecting\u2026</title>
-<link rel="canonical" href="http://fluo.io/blog/2015/12/22/beta-2-pre-release-stress-test/">
-<meta http-equiv="refresh" content="0; url=http://fluo.io/blog/2015/12/22/beta-2-pre-release-stress-test/">
+<link rel="canonical" href="https://fluo.apache.org/blog/2015/12/22/beta-2-pre-release-stress-test/">
+<meta http-equiv="refresh" content="0; url=https://fluo.apache.org/blog/2015/12/22/beta-2-pre-release-stress-test/">
<h1>Redirecting\u2026</h1>
-<a href="http://fluo.io/blog/2015/12/22/beta-2-pre-release-stress-test/">Click here if you are not redirected.</a>
-<script>location="http://fluo.io/blog/2015/12/22/beta-2-pre-release-stress-test/"</script>
+<a href="https://fluo.apache.org/blog/2015/12/22/beta-2-pre-release-stress-test/">Click here if you are not redirected.</a>
+<script>location="https://fluo.apache.org/blog/2015/12/22/beta-2-pre-release-stress-test/"</script>
</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2014/10/02/fluo-1.0.0-alpha-1-is-released/index.html
----------------------------------------------------------------------
diff --git a/blog/2014/10/02/fluo-1.0.0-alpha-1-is-released/index.html b/blog/2014/10/02/fluo-1.0.0-alpha-1-is-released/index.html
deleted file mode 100644
index de21ced..0000000
--- a/blog/2014/10/02/fluo-1.0.0-alpha-1-is-released/index.html
+++ /dev/null
@@ -1,124 +0,0 @@
-<!DOCTYPE html>
-<html>
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <link rel="stylesheet" href="/stylesheets/fluo.css">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2014/10/02/fluo-1.0.0-alpha-1-is-released/">
- <link rel="icon" type="image/png" href="/resources/favicon.png">
- <title>Fluo 1.0.0-alpha-1 is released! | Apache Fluo</title>
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
- <div id="fluo-nav" class="navbar navbar-default navbar-static-top">
- <div class="container">
- <div class="navbar-header">
- <div class="navbar-toggle-wrapper visible-xs">
- <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".js-navbar-collapse">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- </div>
- <a href="/" class="navbar-brand"><img src="/resources/fluo-logo.png" alt="Apache Fluo"></a>
- </div>
- <div class="collapse navbar-collapse js-navbar-collapse" style="margin-top: 20px">
- <ul class="navbar-nav nav">
- <li><a href="/release/">Releases</a></li>
- <li><a href="/tour/">Tour</a></li>
- <li><a href="/docs/">Docs</a></li>
- <li><a href="/apidocs/">API</a></li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
- <li><a href="/people/">People</a></li>
- <li><a href="/related-projects/">Related Projects</a></li>
- <li><a href="/poweredby/">Powered By</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Contributing<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/how-to-contribute/">How To Contribute</a></li>
- <li><a href="/release-process/">Release Process</a></li>
- </ul>
- </li>
- </ul>
- <ul class="navbar-nav nav navbar-right">
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="https://www.apache.org">Apache Homepage</a></li>
- <li><a href="https://www.apache.org/licenses/LICENSE-2.0">License</a></li>
- <li><a href="https://www.apache.org/foundation/sponsorship">Sponsorship</i></a></li>
- <li><a href="https://www.apache.org/security">Security</a></li>
- <li><a href="https://www.apache.org/foundation/thanks">Thanks</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
- </div>
- </div>
- <div class="container">
- <div class="row">
- <div class="col-sm-12">
- <div id="post-header">
- <h2>Fluo 1.0.0-alpha-1 is released!</h1>
- <p class="text-muted">02 Oct 2014</p>
-</div>
-<div id="post-content">
- <p>The Fluo project is happy to announce the <a href="/release/fluo-1.0.0-alpha-1/">1.0.0-alpha-1</a> release of <a href="https://github.com/fluo-io/fluo">Fluo</a>.</p>
-
-<p>This is the first release of Fluo and is not ready for production use. We invite developers to try it out, play with the <a href="https://github.com/fluo-io/fluo-quickstart">quickstart</a> & <a href="https://github.com/fluo-io/phrasecount">phrasecount</a> examples, and contribute back in the form of bug reports, new feature requests, and pull requests.</p>
-
-<p>Fluo is an implementation of Google\u2019s <a href="http://research.google.com/pubs/pub36726.html">percolator paper</a>, which adds large-scale incremental processing of data using distributed transactions and notifications. It runs on <a href="http://hadoop.apache.org/docs/r2.5.1/hadoop-yarn/hadoop-yarn-site/YARN.html">YARN</a> using <a href="http://twill.incubator.apache.org/">Twill</a> and stores its data in <a href="https://accumulo.apache.org/">Accumulo</a>.</p>
-
-<p><a href="/release-notes/fluo-1.0.0-alpha-1/">Release notes</a> and <a href="/apidocs/fluo/1.0.0-alpha-1/">javadocs</a> are available. The <a href="http://search.maven.org/#search%7Cga%7C1%7Cfluo">fluo jars</a> have been deployed to Maven Central</p>
-
-
-</div>
-
-<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
-</div>
-
- </div>
- </div>
- <hr>
- <div class="row footer">
- <div class="col-sm-12 text-center">
- <div class="center-block">
- <a href="https://apache.org"><img src="/resources/feather.png" alt="Apache"></a>
- Copyright © 2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>
- </div>
- </div>
- </div>
- </div>
- <script src="/javascripts/jquery.min.js"></script>
- <script src="/javascripts/bootstrap.min.js"></script>
- <!-- Place your <script> tags here. -->
-
-<!-- Google Analytics -->
-<script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-55360307-1', 'auto');
- ga('send', 'pageview');
-
-</script>
-
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2014/12/30/stress-test-long-run/index.html
----------------------------------------------------------------------
diff --git a/blog/2014/12/30/stress-test-long-run/index.html b/blog/2014/12/30/stress-test-long-run/index.html
index e0d1366..b343d14 100644
--- a/blog/2014/12/30/stress-test-long-run/index.html
+++ b/blog/2014/12/30/stress-test-long-run/index.html
@@ -8,7 +8,7 @@
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2014/12/30/stress-test-long-run/">
+ <link rel="canonical" href="https://fluo.apache.org//blog/2014/12/30/stress-test-long-run/">
<link rel="icon" type="image/png" href="/resources/favicon.png">
<title>First long stress test run on Fluo | Apache Fluo</title>
<!--[if lt IE 9]>
@@ -39,7 +39,7 @@
<a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
<ul class="dropdown-menu">
<li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
+ <li><a href="/news/">News Archive</a></li>
<li><a href="/people/">People</a></li>
<li><a href="/related-projects/">Related Projects</a></li>
<li><a href="/poweredby/">Powered By</a></li>
@@ -227,7 +227,7 @@ implementing issues like <a href="https://github.com/fluo-io/fluo/issues/12">#12
</div>
<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
+ <p class="text-muted">View all posts in the <a href="/news/">news archive</a></p>
</div>
</div>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2015/05/22/fluo-talk-at-accumulo-summit/index.html
----------------------------------------------------------------------
diff --git a/blog/2015/05/22/fluo-talk-at-accumulo-summit/index.html b/blog/2015/05/22/fluo-talk-at-accumulo-summit/index.html
index 9889ba4..9b095ec 100644
--- a/blog/2015/05/22/fluo-talk-at-accumulo-summit/index.html
+++ b/blog/2015/05/22/fluo-talk-at-accumulo-summit/index.html
@@ -8,7 +8,7 @@
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2015/05/22/fluo-talk-at-accumulo-summit/">
+ <link rel="canonical" href="https://fluo.apache.org//blog/2015/05/22/fluo-talk-at-accumulo-summit/">
<link rel="icon" type="image/png" href="/resources/favicon.png">
<title>Fluo talk at Accumulo Summit | Apache Fluo</title>
<!--[if lt IE 9]>
@@ -39,7 +39,7 @@
<a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
<ul class="dropdown-menu">
<li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
+ <li><a href="/news/">News Archive</a></li>
<li><a href="/people/">People</a></li>
<li><a href="/related-projects/">Related Projects</a></li>
<li><a href="/poweredby/">Powered By</a></li>
@@ -85,7 +85,7 @@
</div>
<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
+ <p class="text-muted">View all posts in the <a href="/news/">news archive</a></p>
</div>
</div>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2015/06/09/fluo-1.0.0-beta-1-is-released/index.html
----------------------------------------------------------------------
diff --git a/blog/2015/06/09/fluo-1.0.0-beta-1-is-released/index.html b/blog/2015/06/09/fluo-1.0.0-beta-1-is-released/index.html
deleted file mode 100644
index aca04a1..0000000
--- a/blog/2015/06/09/fluo-1.0.0-beta-1-is-released/index.html
+++ /dev/null
@@ -1,129 +0,0 @@
-<!DOCTYPE html>
-<html>
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <link rel="stylesheet" href="/stylesheets/fluo.css">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2015/06/09/fluo-1.0.0-beta-1-is-released/">
- <link rel="icon" type="image/png" href="/resources/favicon.png">
- <title>Fluo 1.0.0-beta-1 is released! | Apache Fluo</title>
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
- <div id="fluo-nav" class="navbar navbar-default navbar-static-top">
- <div class="container">
- <div class="navbar-header">
- <div class="navbar-toggle-wrapper visible-xs">
- <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".js-navbar-collapse">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- </div>
- <a href="/" class="navbar-brand"><img src="/resources/fluo-logo.png" alt="Apache Fluo"></a>
- </div>
- <div class="collapse navbar-collapse js-navbar-collapse" style="margin-top: 20px">
- <ul class="navbar-nav nav">
- <li><a href="/release/">Releases</a></li>
- <li><a href="/tour/">Tour</a></li>
- <li><a href="/docs/">Docs</a></li>
- <li><a href="/apidocs/">API</a></li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
- <li><a href="/people/">People</a></li>
- <li><a href="/related-projects/">Related Projects</a></li>
- <li><a href="/poweredby/">Powered By</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Contributing<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/how-to-contribute/">How To Contribute</a></li>
- <li><a href="/release-process/">Release Process</a></li>
- </ul>
- </li>
- </ul>
- <ul class="navbar-nav nav navbar-right">
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="https://www.apache.org">Apache Homepage</a></li>
- <li><a href="https://www.apache.org/licenses/LICENSE-2.0">License</a></li>
- <li><a href="https://www.apache.org/foundation/sponsorship">Sponsorship</i></a></li>
- <li><a href="https://www.apache.org/security">Security</a></li>
- <li><a href="https://www.apache.org/foundation/thanks">Thanks</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
- </div>
- </div>
- <div class="container">
- <div class="row">
- <div class="col-sm-12">
- <div id="post-header">
- <h2>Fluo 1.0.0-beta-1 is released!</h1>
- <p class="text-muted">09 Jun 2015</p>
-</div>
-<div id="post-content">
- <p>The Fluo project is happy to announce the <a href="/release/fluo-1.0.0-beta-1/">1.0.0-beta-1</a> release of <a href="https://github.com/fluo-io/fluo">Fluo</a>. This is the second
-release of Fluo.</p>
-
-<p>We invite developers read the Fluo <a href="/docs/fluo/1.0.0-beta-1/">documentation</a>, play with the <a href="https://github.com/fluo-io/fluo-quickstart">quickstart</a> & <a href="https://github.com/fluo-io/phrasecount">phrasecount</a>
-examples, and contribute back in the form of bug reports, new feature requests, and pull requests.</p>
-
-<p>Fluo is an implementation of Google\u2019s <a href="http://research.google.com/pubs/pub36726.html">percolator paper</a>, which adds large-scale incremental
-processing of data using distributed transactions and notifications. It runs on <a href="http://hadoop.apache.org/docs/r2.5.1/hadoop-yarn/hadoop-yarn-site/YARN.html">YARN</a> and stores its
-data in <a href="https://accumulo.apache.org/">Accumulo</a>.</p>
-
-<p><a href="/release-notes/fluo-1.0.0-beta-1/">Release notes</a> and <a href="/apidocs/fluo/1.0.0-beta-1/">javadocs</a> are available. The Fluo <a href="http://search.maven.org/#search%7Cga%7C1%7Cfluo">jars</a> have been deployed to
-Maven Central.</p>
-
-
-</div>
-
-<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
-</div>
-
- </div>
- </div>
- <hr>
- <div class="row footer">
- <div class="col-sm-12 text-center">
- <div class="center-block">
- <a href="https://apache.org"><img src="/resources/feather.png" alt="Apache"></a>
- Copyright © 2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>
- </div>
- </div>
- </div>
- </div>
- <script src="/javascripts/jquery.min.js"></script>
- <script src="/javascripts/bootstrap.min.js"></script>
- <!-- Place your <script> tags here. -->
-
-<!-- Google Analytics -->
-<script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-55360307-1', 'auto');
- ga('send', 'pageview');
-
-</script>
-
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2015/12/22/beta-2-pre-release-stress-test/index.html
----------------------------------------------------------------------
diff --git a/blog/2015/12/22/beta-2-pre-release-stress-test/index.html b/blog/2015/12/22/beta-2-pre-release-stress-test/index.html
index 7ac1799..9d6101d 100644
--- a/blog/2015/12/22/beta-2-pre-release-stress-test/index.html
+++ b/blog/2015/12/22/beta-2-pre-release-stress-test/index.html
@@ -8,7 +8,7 @@
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
<link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
<link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2015/12/22/beta-2-pre-release-stress-test/">
+ <link rel="canonical" href="https://fluo.apache.org//blog/2015/12/22/beta-2-pre-release-stress-test/">
<link rel="icon" type="image/png" href="/resources/favicon.png">
<title>Beta 2 pre-release stress test | Apache Fluo</title>
<!--[if lt IE 9]>
@@ -39,7 +39,7 @@
<a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
<ul class="dropdown-menu">
<li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
+ <li><a href="/news/">News Archive</a></li>
<li><a href="/people/">People</a></li>
<li><a href="/related-projects/">Related Projects</a></li>
<li><a href="/poweredby/">Powered By</a></li>
@@ -78,7 +78,7 @@
</div>
<div id="post-content">
<p>In preperation for a beta 2 release, the <a href="https://github.com/fluo-io/fluo-stress">stress test</a> was run again on EC2.
-The test went well outperforming the <a href="/blog/2014/12/30/stress-test-long-run/">first stress test</a> and <a href="/release-notes/fluo-1.0.0-beta-1/">beta-1 stress
+The test went well outperforming the <a href="/blog/2014/12/30/stress-test-long-run/">first stress test</a> and <a href="/release/fluo-1.0.0-beta-1/">beta-1 stress
test</a>.</p>
<p>For this test run, initially ~1 billion random integers were generated and
@@ -135,7 +135,7 @@ done with an empty table.</p>
</div>
<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
+ <p class="text-muted">View all posts in the <a href="/news/">news archive</a></p>
</div>
</div>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2016/01/10/webindex-long-run/index.html
----------------------------------------------------------------------
diff --git a/blog/2016/01/10/webindex-long-run/index.html b/blog/2016/01/10/webindex-long-run/index.html
deleted file mode 100644
index 4a398c8..0000000
--- a/blog/2016/01/10/webindex-long-run/index.html
+++ /dev/null
@@ -1,314 +0,0 @@
-<!DOCTYPE html>
-<html>
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <link rel="stylesheet" href="/stylesheets/fluo.css">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2016/01/10/webindex-long-run/">
- <link rel="icon" type="image/png" href="/resources/favicon.png">
- <title>Running Webindex for 3 days on EC2 | Apache Fluo</title>
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
- <div id="fluo-nav" class="navbar navbar-default navbar-static-top">
- <div class="container">
- <div class="navbar-header">
- <div class="navbar-toggle-wrapper visible-xs">
- <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".js-navbar-collapse">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- </div>
- <a href="/" class="navbar-brand"><img src="/resources/fluo-logo.png" alt="Apache Fluo"></a>
- </div>
- <div class="collapse navbar-collapse js-navbar-collapse" style="margin-top: 20px">
- <ul class="navbar-nav nav">
- <li><a href="/release/">Releases</a></li>
- <li><a href="/tour/">Tour</a></li>
- <li><a href="/docs/">Docs</a></li>
- <li><a href="/apidocs/">API</a></li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
- <li><a href="/people/">People</a></li>
- <li><a href="/related-projects/">Related Projects</a></li>
- <li><a href="/poweredby/">Powered By</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Contributing<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/how-to-contribute/">How To Contribute</a></li>
- <li><a href="/release-process/">Release Process</a></li>
- </ul>
- </li>
- </ul>
- <ul class="navbar-nav nav navbar-right">
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="https://www.apache.org">Apache Homepage</a></li>
- <li><a href="https://www.apache.org/licenses/LICENSE-2.0">License</a></li>
- <li><a href="https://www.apache.org/foundation/sponsorship">Sponsorship</i></a></li>
- <li><a href="https://www.apache.org/security">Security</a></li>
- <li><a href="https://www.apache.org/foundation/thanks">Thanks</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
- </div>
- </div>
- <div class="container">
- <div class="row">
- <div class="col-sm-12">
- <div id="post-header">
- <h2>Running Webindex for 3 days on EC2</h1>
- <p class="text-muted">10 Jan 2016</p>
-</div>
-<div id="post-content">
- <p>In preparation for the Fluo beta 2 release, <a href="http://github.com/fluo-io/webindex">Webindex</a>, an example
-Fluo application, was run on 24 EC2 m3-xlarge nodes (20 worker node) for 3
-days. The experiment went well as Webindex indexed 178 million web pages and
-2.32 billion links. The average rate for the entire test was 698 pages/sec and
-8,943 links/sec. A few problems with <a href="http://github.com/fluo-io/fluo-recipes">Fluo Recipes</a> and Webindex were
-discovered during the course of the test.</p>
-
-<h2 id="webindex-overview">Webindex Overview</h2>
-
-<p>Webindex indexes URLs from <a href="https://commoncrawl.org/">Common Crawl</a> data in multiple ways into an
-external <a href="http://accumulo.apache.org/">Accumulo</a> table. Webindex offers a simple web application
-for querying this external Accumulo table. The following three questions can
-be answered from this web page.</p>
-
-<ul>
- <li>Which page is the most linked to?</li>
- <li>Which page in a domain is the most linked to and how many pages were seen for a domain?</li>
- <li>For a given page, what links to it and how many links are there?</li>
-</ul>
-
-<p>In order to answer these questions, Webindex continually updates the following
-three indexes in an external Accumulo table.</p>
-
-<ul>
- <li>A per domain index containing linked to counts in descending order.</li>
- <li>A total index containing linked to counts for all pages in descending order.</li>
- <li>A per page index containing the pages incoming and outgoing links and incoming link count.</li>
-</ul>
-
-<p>The following is a simple example of some of what Webindex does. In order to
-keep it simple, the example below does not show everything Webindex does.</p>
-
-<ol>
- <li>Content for <code class="highlighter-rouge">http://A.com</code> that links to <code class="highlighter-rouge">http://B.org</code> is loaded.</li>
- <li>Content for <code class="highlighter-rouge">http://C.com</code> that links to <code class="highlighter-rouge">http://B.org</code> is loaded.</li>
- <li>The inbound link count for <code class="highlighter-rouge">http://B.org</code> is computed as 2.</li>
- <li><code class="highlighter-rouge">(2,http://B.org)</code> is inserted into the external domain index, total index, and page count.</li>
- <li>Content for <code class="highlighter-rouge">http://C.com</code> that links to <code class="highlighter-rouge">http://B.org</code> is loaded.</li>
- <li>The inbound link count for <code class="highlighter-rouge">http://B.org</code> is computed as 3.</li>
- <li><code class="highlighter-rouge">(2,http://B.org)</code> is deleted from all the external indexes and <code class="highlighter-rouge">(3, http://B.org)</code> is inserted.</li>
-</ol>
-
-<h2 id="videos-from-run">Videos from run</h2>
-
-<p>During the course of the 3 day run, screenshots of different queries in the
-Webindex web application were taken every 6 minutes. From these screenshots,
-the following videos were created showing Fluo in action. Keep in mind that as
-the counts are changing, the old count is deleted and a new count is inserted.
-If Fluo ever dropped the ball on this, it would leave both entries in the
-external index causing the same URL to show up twice with different counts.</p>
-
-<p>The video below shows querying for the most linked to page every 6 minutes.</p>
-
-<iframe width="715" height="402" src="https://www.youtube.com/embed/Munsucq1KXo" frameborder="0" allowfullscreen=""></iframe>
-
-<p>The video below shows querying for which pages at stackoverflow.com are the most
-linked to. The count at the top is the total number of pages seen in the
-wikipedia.org domain.</p>
-
-<iframe width="715" height="402" src="https://www.youtube.com/embed/mJJNJbPN2EI" frameborder="0" allowfullscreen=""></iframe>
-
-<p>Videos were also created for <a href="http://youtu.be/9kvYzgg72Es">apache</a>,
-<a href="https://youtu.be/a-9_hnRprpQ">wikipedia</a>,
-<a href="https://youtu.be/IlJ95dVkLnk">github</a>, and <a href="https://youtu.be/D66nBP5QKS8">cnn</a></p>
-
-<p>Some custom scripts and <a href="https://github.com/sindresorhus/pageres-cli">pageres-cli</a> were used to generate the screenshots.
-Videos with a screenshot every minute are also available. If interested in
-seeing these, contact the Fluo dev list.</p>
-
-<h2 id="grafana-plots">Grafana plots</h2>
-
-<p>The Grafana plots below are from the three day run. No plot of notifications
-queued is shown because processing of pages kept up and never fell behind. To
-understand the plots, below is a simple description of what the different
-observers do. Observers are written by Fluo users, run by Fluo workers, and
-respond to notifications and execute transactions.</p>
-
-<ul>
- <li>The PageLoader runs in a Spark job and loads pages parsed from a CommonCrawl
-data file.</li>
- <li>The PageObserver processes updates to pages, determines what links changed,
-and pushes link updates to other observers.</li>
- <li>The CollisionFreeMapObserver computes linked to counts and pushes the counts
-to the ExportObserver. This observer also rolls up domain counts and pushes
-those for export (calling different code and operating on a different part of
-the table).</li>
- <li>The ExportObserver updates the external Accumulo index table in a fault
-tolerant manner.</li>
-</ul>
-
-<p><img src="/resources/blog/webindex_run_201601/grafana-1.png" alt="Grafana long run" /></p>
-
-<h2 id="problems-found">Problems Found</h2>
-
-<p>The test was useful in that it showed Fluo is probably ready for another
-release. While no show stoppers were found, it was also useful in that many
-areas where improvements could be made were found.</p>
-
-<p>During the first day of the test, it was noticed that major compactions in
-Accumulo were sucking up a lot of resources. Each node only had four cores.
-Before the test were started, compaction ratios were adjusted. Fluo\u2019s table
-was set to 1.5 and the external index table was set to 2. These ratios coupled
-with the fact that the compactions were using gzip caused really high load,
-which eventually caused processing to drop to around 500 pages/sec. While the
-test was running the compaction ratios were adjusted to 2 and 3, and compaction
-was set use snappy. This caused performance to increase. A few more cores
-would have been nice.</p>
-
-<p>The Spark load jobs have to parse, validate, and clean up all of the links.
-This seems to be very CPU intensive and may be the current bottleneck (see
-<a href="https://github.com/fluo-io/webindex/issues/41">fluo-io/webindex#41</a>). It seems that as Accumulo\u2019s CPU load
-increased (because of compactions) that the load rate dropped. As an
-experiment during the 2nd day of the test, loaders were stopped and two loaders
-per node were started. This resulted in a higher load rate of around 1000
-pages/sec. In order to ensure the test would run over night, this was only
-done for a brief period before reverting to one loader per node. Again, more
-cores would have been nice. In place of more cores, looking into optimizing this
-and getting a higher load rate would nice. Another issue noticed with loading
-was <a href="https://github.com/fluo-io/webindex/issues/39">fluo-io/webindex#39</a>.</p>
-
-<p>While monitoring the test it became apparent that split points for the Fluo
-table were not equally spreading computation across all tablet servers. See
-<a href="https://github.com/fluo-io/fluo-recipes/issues/44">fluo-io/fluo-recipes#44</a> for more information. Somewhere around the
-2nd day of the test, tablets were merged and new splits points were added while
-the test was running. This worked really well. Another issue found relating
-to split points was <a href="https://github.com/fluo-io/webindex/issues/40">fluo-io/webindex#40</a>.</p>
-
-<p>The lack of metrics about Conditional mutations from Accumulo tablet servers
-makes it hard to track down problems where many Fluo transactions are hitting a
-few tablet servers. The bad split points mentioned in the previous paragraph
-are one example of this type of problem. <a href="https://issues.apache.org/jira/browse/ACCUMULO-4107">ACCUMULO-4107</a> was
-created to address this issue.</p>
-
-<p>Some skew was noticed as a result of YARN\u2019s placement decisions. This was
-caused by coordination task displacing CPU intensive task. For example
-Fluo has three task types that run in YARN : Oracle, Twill Application manager,
-and Workers. Ideally there would be one Worker per node. However, because of
-the Oracle and Application task, YARN may place two workers on a single node.
-Opened <a href="https://github.com/fluo-io/fluo/issues/600">fluo-io/fluo#600</a>.</p>
-
-<p>During the test, worker task were dying or being killed because of memory
-overuse. Twill/YARN automatically restarted the workers and the test kept
-running w/o much problem. It would be good to avoid this since this causes
-transaction recovery or rollback. See <a href="https://github.com/fluo-io/webindex/issues/42">fluo-io/webindex#42</a>.</p>
-
-<p>The test identified a possible need for <a href="https://github.com/fluo-io/fluo-recipes/issues/45">HashedRow recipe</a> to more
-evenly distribute processing of page related transactions.</p>
-
-<h2 id="test-environment">Test environment</h2>
-
-<p>The following configuration and software were used for this test.</p>
-
-<ul>
- <li>24 m3.xlarge EC2 nodes. 15G ram, 4 cores, and 2x35G SSD.</li>
- <li>Centos 7</li>
- <li>Hadoop 2.6.0</li>
- <li>Zookeeper 3.4.7</li>
- <li>Accumulo 1.8.0-SNAPSHOT with <a href="https://issues.apache.org/jira/browse/ACCUMULO-4066">ACCUMULO-4066</a> patches</li>
- <li>Fluo beta-2-SNAPSHOT 78bcdb7</li>
- <li>Fluo recipes beta-1-SNAPSHOT 96858d0</li>
- <li>Fluo deploy 43bf08f</li>
- <li>2G data cache and 768M index cache in Accumulo</li>
- <li>64 threads in Accumulo client pool and readahead pool</li>
- <li>128 worker threads and 4G per worker (initially went to 5G and 6G as test was running).</li>
- <li>20 Load task running in Spark</li>
-</ul>
-
-<h2 id="storage-statistics">Storage statistics</h2>
-
-<p>After the three day run completed, the external index table had 4.71 billion
-entries and used 191G in HDFS. A compaction was forced on the Accumulo table,
-which caused old versions and deleted data to be dropped. After the compaction
-the table had 4.02 billion entries and used 159G in HDFS. The table was being
-frequently updated by Fluo and that\u2019s why so much data was dropped by the
-compaction. The way Accumulo works, compactions were continually happening
-while test was running. So the total amount of data dropped from the table as
-a result of updates is unknown.</p>
-
-<p>The table used by Fluo had 1.46 billion entries at the conclusion of the test
-and used 93G in HDFS.</p>
-
-<h2 id="future-work">Future Work</h2>
-
-<p>Most Fluo scale testing to date has been on EC2. It would be really nice to
-test Fluo on bare metal. We are going to experiment with getting <a href="https://github.com/fluo-io/fluo-deploy">Fluo
-Deploy</a> to work on bare metal where
-CentOS 7 is already installed.</p>
-
-<p>Seeing Application level stats plotted in Grafana, as outlined in
-<a href="https://github.com/fluo-io/fluo/issues/534">fluo-io/fluo#534</a>, would be really nice. For webindex this would
-include things like URLs exported per second, domains exported per second, etc.
-This issue was not identified during this test, it just would have been really
-nice to have this information while running the test.</p>
-
-<p>Eventually this test needs to be run on 10, 20, and 40 nodes to measure the
-relative performance increase as the number of nodes is increased. Ideally
-this test would run on bare metal.</p>
-
-
-</div>
-
-<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
-</div>
-
- </div>
- </div>
- <hr>
- <div class="row footer">
- <div class="col-sm-12 text-center">
- <div class="center-block">
- <a href="https://apache.org"><img src="/resources/feather.png" alt="Apache"></a>
- Copyright © 2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>
- </div>
- </div>
- </div>
- </div>
- <script src="/javascripts/jquery.min.js"></script>
- <script src="/javascripts/bootstrap.min.js"></script>
- <!-- Place your <script> tags here. -->
-
-<!-- Google Analytics -->
-<script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-55360307-1', 'auto');
- ga('send', 'pageview');
-
-</script>
-
- </body>
-</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2016/01/11/webindex-long-run/index.html
----------------------------------------------------------------------
diff --git a/blog/2016/01/11/webindex-long-run/index.html b/blog/2016/01/11/webindex-long-run/index.html
new file mode 100644
index 0000000..06cb3aa
--- /dev/null
+++ b/blog/2016/01/11/webindex-long-run/index.html
@@ -0,0 +1,314 @@
+<!DOCTYPE html>
+<html>
+ <head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+ <link rel="stylesheet" href="/stylesheets/fluo.css">
+ <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
+ <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
+ <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
+ <link rel="canonical" href="https://fluo.apache.org//blog/2016/01/11/webindex-long-run/">
+ <link rel="icon" type="image/png" href="/resources/favicon.png">
+ <title>Running Webindex for 3 days on EC2 | Apache Fluo</title>
+ <!--[if lt IE 9]>
+ <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
+ <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
+ <![endif]-->
+ </head>
+ <body>
+ <div id="fluo-nav" class="navbar navbar-default navbar-static-top">
+ <div class="container">
+ <div class="navbar-header">
+ <div class="navbar-toggle-wrapper visible-xs">
+ <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".js-navbar-collapse">
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+ </div>
+ <a href="/" class="navbar-brand"><img src="/resources/fluo-logo.png" alt="Apache Fluo"></a>
+ </div>
+ <div class="collapse navbar-collapse js-navbar-collapse" style="margin-top: 20px">
+ <ul class="navbar-nav nav">
+ <li><a href="/release/">Releases</a></li>
+ <li><a href="/tour/">Tour</a></li>
+ <li><a href="/docs/">Docs</a></li>
+ <li><a href="/apidocs/">API</a></li>
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
+ <ul class="dropdown-menu">
+ <li><a href="/getinvolved/">Get Involved</a></li>
+ <li><a href="/news/">News Archive</a></li>
+ <li><a href="/people/">People</a></li>
+ <li><a href="/related-projects/">Related Projects</a></li>
+ <li><a href="/poweredby/">Powered By</a></li>
+ </ul>
+ </li>
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">Contributing<span class="caret"></span></a>
+ <ul class="dropdown-menu">
+ <li><a href="/how-to-contribute/">How To Contribute</a></li>
+ <li><a href="/release-process/">Release Process</a></li>
+ </ul>
+ </li>
+ </ul>
+ <ul class="navbar-nav nav navbar-right">
+ <li class="dropdown">
+ <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a>
+ <ul class="dropdown-menu">
+ <li><a href="https://www.apache.org">Apache Homepage</a></li>
+ <li><a href="https://www.apache.org/licenses/LICENSE-2.0">License</a></li>
+ <li><a href="https://www.apache.org/foundation/sponsorship">Sponsorship</i></a></li>
+ <li><a href="https://www.apache.org/security">Security</a></li>
+ <li><a href="https://www.apache.org/foundation/thanks">Thanks</a></li>
+ <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
+ </ul>
+ </li>
+ </ul>
+ </div>
+ </div>
+ </div>
+ <div class="container">
+ <div class="row">
+ <div class="col-sm-12">
+ <div id="post-header">
+ <h2>Running Webindex for 3 days on EC2</h1>
+ <p class="text-muted">11 Jan 2016</p>
+</div>
+<div id="post-content">
+ <p>In preparation for the Fluo beta 2 release, <a href="http://github.com/fluo-io/webindex">Webindex</a>, an example
+Fluo application, was run on 24 EC2 m3-xlarge nodes (20 worker node) for 3
+days. The experiment went well as Webindex indexed 178 million web pages and
+2.32 billion links. The average rate for the entire test was 698 pages/sec and
+8,943 links/sec. A few problems with <a href="http://github.com/fluo-io/fluo-recipes">Fluo Recipes</a> and Webindex were
+discovered during the course of the test.</p>
+
+<h2 id="webindex-overview">Webindex Overview</h2>
+
+<p>Webindex indexes URLs from <a href="https://commoncrawl.org/">Common Crawl</a> data in multiple ways into an
+external <a href="http://accumulo.apache.org/">Accumulo</a> table. Webindex offers a simple web application
+for querying this external Accumulo table. The following three questions can
+be answered from this web page.</p>
+
+<ul>
+ <li>Which page is the most linked to?</li>
+ <li>Which page in a domain is the most linked to and how many pages were seen for a domain?</li>
+ <li>For a given page, what links to it and how many links are there?</li>
+</ul>
+
+<p>In order to answer these questions, Webindex continually updates the following
+three indexes in an external Accumulo table.</p>
+
+<ul>
+ <li>A per domain index containing linked to counts in descending order.</li>
+ <li>A total index containing linked to counts for all pages in descending order.</li>
+ <li>A per page index containing the pages incoming and outgoing links and incoming link count.</li>
+</ul>
+
+<p>The following is a simple example of some of what Webindex does. In order to
+keep it simple, the example below does not show everything Webindex does.</p>
+
+<ol>
+ <li>Content for <code class="highlighter-rouge">http://A.com</code> that links to <code class="highlighter-rouge">http://B.org</code> is loaded.</li>
+ <li>Content for <code class="highlighter-rouge">http://C.com</code> that links to <code class="highlighter-rouge">http://B.org</code> is loaded.</li>
+ <li>The inbound link count for <code class="highlighter-rouge">http://B.org</code> is computed as 2.</li>
+ <li><code class="highlighter-rouge">(2,http://B.org)</code> is inserted into the external domain index, total index, and page count.</li>
+ <li>Content for <code class="highlighter-rouge">http://C.com</code> that links to <code class="highlighter-rouge">http://B.org</code> is loaded.</li>
+ <li>The inbound link count for <code class="highlighter-rouge">http://B.org</code> is computed as 3.</li>
+ <li><code class="highlighter-rouge">(2,http://B.org)</code> is deleted from all the external indexes and <code class="highlighter-rouge">(3, http://B.org)</code> is inserted.</li>
+</ol>
+
+<h2 id="videos-from-run">Videos from run</h2>
+
+<p>During the course of the 3 day run, screenshots of different queries in the
+Webindex web application were taken every 6 minutes. From these screenshots,
+the following videos were created showing Fluo in action. Keep in mind that as
+the counts are changing, the old count is deleted and a new count is inserted.
+If Fluo ever dropped the ball on this, it would leave both entries in the
+external index causing the same URL to show up twice with different counts.</p>
+
+<p>The video below shows querying for the most linked to page every 6 minutes.</p>
+
+<iframe width="715" height="402" src="https://www.youtube.com/embed/Munsucq1KXo" frameborder="0" allowfullscreen=""></iframe>
+
+<p>The video below shows querying for which pages at stackoverflow.com are the most
+linked to. The count at the top is the total number of pages seen in the
+wikipedia.org domain.</p>
+
+<iframe width="715" height="402" src="https://www.youtube.com/embed/mJJNJbPN2EI" frameborder="0" allowfullscreen=""></iframe>
+
+<p>Videos were also created for <a href="http://youtu.be/9kvYzgg72Es">apache</a>,
+<a href="https://youtu.be/a-9_hnRprpQ">wikipedia</a>,
+<a href="https://youtu.be/IlJ95dVkLnk">github</a>, and <a href="https://youtu.be/D66nBP5QKS8">cnn</a></p>
+
+<p>Some custom scripts and <a href="https://github.com/sindresorhus/pageres-cli">pageres-cli</a> were used to generate the screenshots.
+Videos with a screenshot every minute are also available. If interested in
+seeing these, contact the Fluo dev list.</p>
+
+<h2 id="grafana-plots">Grafana plots</h2>
+
+<p>The Grafana plots below are from the three day run. No plot of notifications
+queued is shown because processing of pages kept up and never fell behind. To
+understand the plots, below is a simple description of what the different
+observers do. Observers are written by Fluo users, run by Fluo workers, and
+respond to notifications and execute transactions.</p>
+
+<ul>
+ <li>The PageLoader runs in a Spark job and loads pages parsed from a CommonCrawl
+data file.</li>
+ <li>The PageObserver processes updates to pages, determines what links changed,
+and pushes link updates to other observers.</li>
+ <li>The CollisionFreeMapObserver computes linked to counts and pushes the counts
+to the ExportObserver. This observer also rolls up domain counts and pushes
+those for export (calling different code and operating on a different part of
+the table).</li>
+ <li>The ExportObserver updates the external Accumulo index table in a fault
+tolerant manner.</li>
+</ul>
+
+<p><img src="/resources/blog/webindex_run_201601/grafana-1.png" alt="Grafana long run" /></p>
+
+<h2 id="problems-found">Problems Found</h2>
+
+<p>The test was useful in that it showed Fluo is probably ready for another
+release. While no show stoppers were found, it was also useful in that many
+areas where improvements could be made were found.</p>
+
+<p>During the first day of the test, it was noticed that major compactions in
+Accumulo were sucking up a lot of resources. Each node only had four cores.
+Before the test were started, compaction ratios were adjusted. Fluo\u2019s table
+was set to 1.5 and the external index table was set to 2. These ratios coupled
+with the fact that the compactions were using gzip caused really high load,
+which eventually caused processing to drop to around 500 pages/sec. While the
+test was running the compaction ratios were adjusted to 2 and 3, and compaction
+was set use snappy. This caused performance to increase. A few more cores
+would have been nice.</p>
+
+<p>The Spark load jobs have to parse, validate, and clean up all of the links.
+This seems to be very CPU intensive and may be the current bottleneck (see
+<a href="https://github.com/fluo-io/webindex/issues/41">fluo-io/webindex#41</a>). It seems that as Accumulo\u2019s CPU load
+increased (because of compactions) that the load rate dropped. As an
+experiment during the 2nd day of the test, loaders were stopped and two loaders
+per node were started. This resulted in a higher load rate of around 1000
+pages/sec. In order to ensure the test would run over night, this was only
+done for a brief period before reverting to one loader per node. Again, more
+cores would have been nice. In place of more cores, looking into optimizing this
+and getting a higher load rate would nice. Another issue noticed with loading
+was <a href="https://github.com/fluo-io/webindex/issues/39">fluo-io/webindex#39</a>.</p>
+
+<p>While monitoring the test it became apparent that split points for the Fluo
+table were not equally spreading computation across all tablet servers. See
+<a href="https://github.com/fluo-io/fluo-recipes/issues/44">fluo-io/fluo-recipes#44</a> for more information. Somewhere around the
+2nd day of the test, tablets were merged and new splits points were added while
+the test was running. This worked really well. Another issue found relating
+to split points was <a href="https://github.com/fluo-io/webindex/issues/40">fluo-io/webindex#40</a>.</p>
+
+<p>The lack of metrics about Conditional mutations from Accumulo tablet servers
+makes it hard to track down problems where many Fluo transactions are hitting a
+few tablet servers. The bad split points mentioned in the previous paragraph
+are one example of this type of problem. <a href="https://issues.apache.org/jira/browse/ACCUMULO-4107">ACCUMULO-4107</a> was
+created to address this issue.</p>
+
+<p>Some skew was noticed as a result of YARN\u2019s placement decisions. This was
+caused by coordination task displacing CPU intensive task. For example
+Fluo has three task types that run in YARN : Oracle, Twill Application manager,
+and Workers. Ideally there would be one Worker per node. However, because of
+the Oracle and Application task, YARN may place two workers on a single node.
+Opened <a href="https://github.com/fluo-io/fluo/issues/600">fluo-io/fluo#600</a>.</p>
+
+<p>During the test, worker task were dying or being killed because of memory
+overuse. Twill/YARN automatically restarted the workers and the test kept
+running w/o much problem. It would be good to avoid this since this causes
+transaction recovery or rollback. See <a href="https://github.com/fluo-io/webindex/issues/42">fluo-io/webindex#42</a>.</p>
+
+<p>The test identified a possible need for <a href="https://github.com/fluo-io/fluo-recipes/issues/45">HashedRow recipe</a> to more
+evenly distribute processing of page related transactions.</p>
+
+<h2 id="test-environment">Test environment</h2>
+
+<p>The following configuration and software were used for this test.</p>
+
+<ul>
+ <li>24 m3.xlarge EC2 nodes. 15G ram, 4 cores, and 2x35G SSD.</li>
+ <li>Centos 7</li>
+ <li>Hadoop 2.6.0</li>
+ <li>Zookeeper 3.4.7</li>
+ <li>Accumulo 1.8.0-SNAPSHOT with <a href="https://issues.apache.org/jira/browse/ACCUMULO-4066">ACCUMULO-4066</a> patches</li>
+ <li>Fluo beta-2-SNAPSHOT 78bcdb7</li>
+ <li>Fluo recipes beta-1-SNAPSHOT 96858d0</li>
+ <li>Fluo deploy 43bf08f</li>
+ <li>2G data cache and 768M index cache in Accumulo</li>
+ <li>64 threads in Accumulo client pool and readahead pool</li>
+ <li>128 worker threads and 4G per worker (initially went to 5G and 6G as test was running).</li>
+ <li>20 Load task running in Spark</li>
+</ul>
+
+<h2 id="storage-statistics">Storage statistics</h2>
+
+<p>After the three day run completed, the external index table had 4.71 billion
+entries and used 191G in HDFS. A compaction was forced on the Accumulo table,
+which caused old versions and deleted data to be dropped. After the compaction
+the table had 4.02 billion entries and used 159G in HDFS. The table was being
+frequently updated by Fluo and that\u2019s why so much data was dropped by the
+compaction. The way Accumulo works, compactions were continually happening
+while test was running. So the total amount of data dropped from the table as
+a result of updates is unknown.</p>
+
+<p>The table used by Fluo had 1.46 billion entries at the conclusion of the test
+and used 93G in HDFS.</p>
+
+<h2 id="future-work">Future Work</h2>
+
+<p>Most Fluo scale testing to date has been on EC2. It would be really nice to
+test Fluo on bare metal. We are going to experiment with getting <a href="https://github.com/fluo-io/fluo-deploy">Fluo
+Deploy</a> to work on bare metal where
+CentOS 7 is already installed.</p>
+
+<p>Seeing Application level stats plotted in Grafana, as outlined in
+<a href="https://github.com/fluo-io/fluo/issues/534">fluo-io/fluo#534</a>, would be really nice. For webindex this would
+include things like URLs exported per second, domains exported per second, etc.
+This issue was not identified during this test, it just would have been really
+nice to have this information while running the test.</p>
+
+<p>Eventually this test needs to be run on 10, 20, and 40 nodes to measure the
+relative performance increase as the number of nodes is increased. Ideally
+this test would run on bare metal.</p>
+
+
+</div>
+
+<div>
+ <p class="text-muted">View all posts in the <a href="/news/">news archive</a></p>
+</div>
+
+ </div>
+ </div>
+ <hr>
+ <div class="row footer">
+ <div class="col-sm-12 text-center">
+ <div class="center-block">
+ <a href="https://apache.org"><img src="/resources/feather.png" alt="Apache"></a>
+ Copyright © 2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>
+ </div>
+ </div>
+ </div>
+ </div>
+ <script src="/javascripts/jquery.min.js"></script>
+ <script src="/javascripts/bootstrap.min.js"></script>
+ <!-- Place your <script> tags here. -->
+
+<!-- Google Analytics -->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
+
+ ga('create', 'UA-55360307-1', 'auto');
+ ga('send', 'pageview');
+
+</script>
+
+ </body>
+</html>
http://git-wip-us.apache.org/repos/asf/incubator-fluo-website/blob/5576766a/blog/2016/01/12/fluo-1.0.0-beta-2-is-released/index.html
----------------------------------------------------------------------
diff --git a/blog/2016/01/12/fluo-1.0.0-beta-2-is-released/index.html b/blog/2016/01/12/fluo-1.0.0-beta-2-is-released/index.html
deleted file mode 100644
index 0f791b4..0000000
--- a/blog/2016/01/12/fluo-1.0.0-beta-2-is-released/index.html
+++ /dev/null
@@ -1,141 +0,0 @@
-<!DOCTYPE html>
-<html>
- <head>
- <meta charset="utf-8">
- <meta http-equiv="X-UA-Compatible" content="IE=edge">
- <meta name="viewport" content="width=device-width, initial-scale=1">
- <link rel="stylesheet" href="/stylesheets/fluo.css">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Montserrat:700,400">
- <link rel="stylesheet" type="text/css" href="https://fonts.googleapis.com/css?family=Merriweather">
- <link rel="stylesheet" href="https://maxcdn.bootstrapcdn.com/font-awesome/4.2.0/css/font-awesome.min.css" >
- <link rel="canonical" href="http://fluo.io/blog/2016/01/12/fluo-1.0.0-beta-2-is-released/">
- <link rel="icon" type="image/png" href="/resources/favicon.png">
- <title>Fluo 1.0.0-beta-2 is released! | Apache Fluo</title>
- <!--[if lt IE 9]>
- <script src="https://oss.maxcdn.com/html5shiv/3.7.2/html5shiv.min.js"></script>
- <script src="https://oss.maxcdn.com/respond/1.4.2/respond.min.js"></script>
- <![endif]-->
- </head>
- <body>
- <div id="fluo-nav" class="navbar navbar-default navbar-static-top">
- <div class="container">
- <div class="navbar-header">
- <div class="navbar-toggle-wrapper visible-xs">
- <button type="button" class="navbar-toggle" data-toggle="collapse" data-target=".js-navbar-collapse">
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- <span class="icon-bar"></span>
- </button>
- </div>
- <a href="/" class="navbar-brand"><img src="/resources/fluo-logo.png" alt="Apache Fluo"></a>
- </div>
- <div class="collapse navbar-collapse js-navbar-collapse" style="margin-top: 20px">
- <ul class="navbar-nav nav">
- <li><a href="/release/">Releases</a></li>
- <li><a href="/tour/">Tour</a></li>
- <li><a href="/docs/">Docs</a></li>
- <li><a href="/apidocs/">API</a></li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/getinvolved/">Get Involved</a></li>
- <li><a href="/blog/">Blog</a></li>
- <li><a href="/people/">People</a></li>
- <li><a href="/related-projects/">Related Projects</a></li>
- <li><a href="/poweredby/">Powered By</a></li>
- </ul>
- </li>
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Contributing<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="/how-to-contribute/">How To Contribute</a></li>
- <li><a href="/release-process/">Release Process</a></li>
- </ul>
- </li>
- </ul>
- <ul class="navbar-nav nav navbar-right">
- <li class="dropdown">
- <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a>
- <ul class="dropdown-menu">
- <li><a href="https://www.apache.org">Apache Homepage</a></li>
- <li><a href="https://www.apache.org/licenses/LICENSE-2.0">License</a></li>
- <li><a href="https://www.apache.org/foundation/sponsorship">Sponsorship</i></a></li>
- <li><a href="https://www.apache.org/security">Security</a></li>
- <li><a href="https://www.apache.org/foundation/thanks">Thanks</a></li>
- <li><a href="https://www.apache.org/foundation/policies/conduct">Code of Conduct</a></li>
- </ul>
- </li>
- </ul>
- </div>
- </div>
- </div>
- <div class="container">
- <div class="row">
- <div class="col-sm-12">
- <div id="post-header">
- <h2>Fluo 1.0.0-beta-2 is released!</h1>
- <p class="text-muted">12 Jan 2016</p>
-</div>
-<div id="post-content">
- <p>The Fluo project is happy to announce a <a href="/release/fluo-1.0.0-beta-2/">1.0.0-beta-2</a> release which is the
-third release of Fluo and likely the final release before 1.0.0. Many
-improvements in this release were driven by the creation of two new Fluo related
-projects:</p>
-
-<ul>
- <li>
- <p><a href="https://github.com/fluo-io/fluo-recipes">Fluo recipes</a> is a collection of common development patterns
-designed to make Fluo application development easier. Creating Fluo recipes
-required new Fluo functionality and updates to the Fluo API. The first release
-of Fluo recipes has been made and is available in <a href="http://search.maven.org/#search|ga|1|fluo-recipes">Maven Central</a>.</p>
- </li>
- <li>
- <p><a href="https://github.com/fluo-io/webindex">WebIndex</a> is an example Fluo application that indexes links to web
-pages in multiple ways. Webindex enabled the testing of Fluo on real data at
-scale. It also inspired improvements to Fluo to allow it to work better with
-Apache Spark.</p>
- </li>
-</ul>
-
-<p>Fluo is now at a point where its two cluster test suites, <a href="https://github.com/fluo-io/webindex">Webindex</a>
-and <a href="https://github.com/fluo-io/fluo-stress">Stress</a>, are running well for long periods on Amazon EC2. We
-invite early adopters to try out the beta-2 release and help flush out problems
-before 1.0.0.</p>
-
-
-</div>
-
-<div>
- <p class="text-muted">View more posts in the <a href="/blog/">Blog archive</a></p>
-</div>
-
- </div>
- </div>
- <hr>
- <div class="row footer">
- <div class="col-sm-12 text-center">
- <div class="center-block">
- <a href="https://apache.org"><img src="/resources/feather.png" alt="Apache"></a>
- Copyright © 2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0">Apache License, Version 2.0</a>
- </div>
- </div>
- </div>
- </div>
- <script src="/javascripts/jquery.min.js"></script>
- <script src="/javascripts/bootstrap.min.js"></script>
- <!-- Place your <script> tags here. -->
-
-<!-- Google Analytics -->
-<script>
- (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
- (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
- m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
- })(window,document,'script','https://www.google-analytics.com/analytics.js','ga');
-
- ga('create', 'UA-55360307-1', 'auto');
- ga('send', 'pageview');
-
-</script>
-
- </body>
-</html>