You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@accumulo.apache.org by mw...@apache.org on 2019/04/24 21:54:29 UTC
[accumulo-website] branch asf-site updated: Jekyll build from
master:858470e
This is an automated email from the ASF dual-hosted git repository.
mwalch pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/accumulo-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 2e30942 Jekyll build from master:858470e
2e30942 is described below
commit 2e30942eee25392159bebd3100d12cf5ca0903cb
Author: Mike Walch <mw...@apache.org>
AuthorDate: Wed Apr 24 17:53:40 2019 -0400
Jekyll build from master:858470e
Created docs for using Apache Spark with Accumulo (#171)
---
README.md | 1 +
docs/2.x/administration/caching.html | 4 +-
docs/2.x/administration/fate.html | 4 +-
docs/2.x/administration/in-depth-install.html | 4 +-
docs/2.x/administration/monitoring-metrics.html | 4 +-
docs/2.x/administration/multivolume.html | 4 +-
docs/2.x/administration/replication.html | 4 +-
docs/2.x/administration/scan-executors.html | 4 +-
docs/2.x/administration/upgrading.html | 4 +-
docs/2.x/configuration/client-properties.html | 4 +-
docs/2.x/configuration/files.html | 4 +-
docs/2.x/configuration/overview.html | 4 +-
docs/2.x/configuration/server-properties.html | 4 +-
docs/2.x/development/development_tools.html | 4 +-
docs/2.x/development/high_speed_ingest.html | 4 +-
docs/2.x/development/iterators.html | 4 +-
docs/2.x/development/mapreduce.html | 4 +-
docs/2.x/development/proxy.html | 4 +-
docs/2.x/development/sampling.html | 4 +-
.../{high_speed_ingest.html => spark.html} | 207 ++++++++++-----------
docs/2.x/development/summaries.html | 4 +-
docs/2.x/getting-started/clients.html | 4 +-
docs/2.x/getting-started/design.html | 4 +-
docs/2.x/getting-started/features.html | 4 +-
docs/2.x/getting-started/glossary.html | 4 +-
docs/2.x/getting-started/quickstart.html | 4 +-
docs/2.x/getting-started/shell.html | 4 +-
docs/2.x/getting-started/table_configuration.html | 4 +-
docs/2.x/getting-started/table_design.html | 4 +-
docs/2.x/security/authentication.html | 4 +-
docs/2.x/security/authorizations.html | 4 +-
docs/2.x/security/kerberos.html | 4 +-
docs/2.x/security/on-disk-encryption.html | 4 +-
docs/2.x/security/overview.html | 4 +-
docs/2.x/security/permissions.html | 4 +-
docs/2.x/security/wire-encryption.html | 4 +-
docs/2.x/troubleshooting/advanced.html | 4 +-
docs/2.x/troubleshooting/basic.html | 4 +-
docs/2.x/troubleshooting/performance.html | 4 +-
.../troubleshooting/system-metadata-tables.html | 4 +-
docs/2.x/troubleshooting/tools.html | 4 +-
docs/2.x/troubleshooting/tracing.html | 4 +-
feed.xml | 4 +-
search_data.json | 7 +
44 files changed, 229 insertions(+), 150 deletions(-)
diff --git a/README.md b/README.md
index b6ed8f5..196cb78 100644
--- a/README.md
+++ b/README.md
@@ -49,6 +49,7 @@ The source for these tags is at [_plugins/links.rb](_plugins/links.rb).
| dlink | Creates Documentation link | None | `{% dlink getting-stared/clients %}` |
| durl | Creates Documentation URL | None | `{% durl troubleshooting/performance %}` |
| ghi | GitHub issue link | None | `{% ghi 100 %}` |
+| ghc | GitHub code link | Branch defaults to `gh_branch` setting in `_config.yml`. Override using `-b` | `{% ghc server/tserver/src/main/java/org/apache/accumulo/tserver/TabletServer.java %}` `{% ghc -b 1.9 README.md %}` |
| jira | Jira issue link | None | `{% jira ACCUMULO-1000 %}` |
## Updating property documentation
diff --git a/docs/2.x/administration/caching.html b/docs/2.x/administration/caching.html
index 8158ee9..9915e62 100644
--- a/docs/2.x/administration/caching.html
+++ b/docs/2.x/administration/caching.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/fate.html b/docs/2.x/administration/fate.html
index f303c9f..0cc8840 100644
--- a/docs/2.x/administration/fate.html
+++ b/docs/2.x/administration/fate.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/in-depth-install.html b/docs/2.x/administration/in-depth-install.html
index 87dfafc..d7f0192 100644
--- a/docs/2.x/administration/in-depth-install.html
+++ b/docs/2.x/administration/in-depth-install.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/monitoring-metrics.html b/docs/2.x/administration/monitoring-metrics.html
index 3969562..b8185a3 100644
--- a/docs/2.x/administration/monitoring-metrics.html
+++ b/docs/2.x/administration/monitoring-metrics.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/multivolume.html b/docs/2.x/administration/multivolume.html
index 9928d7d..077b51d 100644
--- a/docs/2.x/administration/multivolume.html
+++ b/docs/2.x/administration/multivolume.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/replication.html b/docs/2.x/administration/replication.html
index c3eac23..5bc4ee7 100644
--- a/docs/2.x/administration/replication.html
+++ b/docs/2.x/administration/replication.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/scan-executors.html b/docs/2.x/administration/scan-executors.html
index 9b69695..35aadaa 100644
--- a/docs/2.x/administration/scan-executors.html
+++ b/docs/2.x/administration/scan-executors.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/administration/upgrading.html b/docs/2.x/administration/upgrading.html
index 408ada2..482443a 100644
--- a/docs/2.x/administration/upgrading.html
+++ b/docs/2.x/administration/upgrading.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/configuration/client-properties.html b/docs/2.x/configuration/client-properties.html
index 8c3f2a4..9a206fc 100644
--- a/docs/2.x/configuration/client-properties.html
+++ b/docs/2.x/configuration/client-properties.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/configuration/files.html b/docs/2.x/configuration/files.html
index e9e02fd..b7e475b 100644
--- a/docs/2.x/configuration/files.html
+++ b/docs/2.x/configuration/files.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/configuration/overview.html b/docs/2.x/configuration/overview.html
index fa1ac02..a6f16fb 100644
--- a/docs/2.x/configuration/overview.html
+++ b/docs/2.x/configuration/overview.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/configuration/server-properties.html b/docs/2.x/configuration/server-properties.html
index c97c7b9..787b748 100644
--- a/docs/2.x/configuration/server-properties.html
+++ b/docs/2.x/configuration/server-properties.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/development_tools.html b/docs/2.x/development/development_tools.html
index c598b4e..fc12b17 100644
--- a/docs/2.x/development/development_tools.html
+++ b/docs/2.x/development/development_tools.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/high_speed_ingest.html b/docs/2.x/development/high_speed_ingest.html
index 7020df3..c192184 100644
--- a/docs/2.x/development/high_speed_ingest.html
+++ b/docs/2.x/development/high_speed_ingest.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/iterators.html b/docs/2.x/development/iterators.html
index 7018c16..af17359 100644
--- a/docs/2.x/development/iterators.html
+++ b/docs/2.x/development/iterators.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/mapreduce.html b/docs/2.x/development/mapreduce.html
index bddcac0..9003e4b 100644
--- a/docs/2.x/development/mapreduce.html
+++ b/docs/2.x/development/mapreduce.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/proxy.html b/docs/2.x/development/proxy.html
index a3c2fe0..7cbdbd9 100644
--- a/docs/2.x/development/proxy.html
+++ b/docs/2.x/development/proxy.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/sampling.html b/docs/2.x/development/sampling.html
index 45c3bd2..df97775 100644
--- a/docs/2.x/development/sampling.html
+++ b/docs/2.x/development/sampling.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/development/high_speed_ingest.html b/docs/2.x/development/spark.html
similarity index 59%
copy from docs/2.x/development/high_speed_ingest.html
copy to docs/2.x/development/spark.html
index 7020df3..b601557 100644
--- a/docs/2.x/development/high_speed_ingest.html
+++ b/docs/2.x/development/spark.html
@@ -25,7 +25,7 @@
<link rel="stylesheet" type="text/css" href="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.css">
<link href="/css/accumulo.css" rel="stylesheet" type="text/css">
-<title>Accumulo Documentation - High-Speed Ingest</title>
+<title>Accumulo Documentation - Spark</title>
<script src="https://cdnjs.cloudflare.com/ajax/libs/jquery/2.2.4/jquery.min.js" integrity="sha256-BbhdlvQf/xTY9gja0Dq3HiwQF8LaCRTXxZKRutelT44=" crossorigin="anonymous"></script>
<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js" integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script>
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,7 +218,9 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
- <div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
</div>
@@ -408,130 +410,119 @@
</div>
<div class="col-md-9">
- <p>Accumulo 2.x Documentation >> Development >> High-Speed Ingest</p>
+ <p>Accumulo 2.x Documentation >> Development >> Spark</p>
<div class="alert alert-danger" style="margin-bottom: 0px;" role="alert">This documentation is for an alpha release of Accumulo! <a href="/1.9/accumulo_user_manual.html">View documentation for the latest release</a>.</div>
<div class="row">
- <div class="col-md-10"><h1>High-Speed Ingest</h1></div>
- <div class="col-md-2"><a class="pull-right" style="margin-top: 25px;" href="https://github.com/apache/accumulo-website/edit/master/_docs-2/development/high_speed_ingest.md" role="button"><i class="glyphicon glyphicon-pencil"></i> <small>Edit this page</small></a></div>
+ <div class="col-md-10"><h1>Spark</h1></div>
+ <div class="col-md-2"><a class="pull-right" style="margin-top: 25px;" href="https://github.com/apache/accumulo-website/edit/master/_docs-2/development/spark.md" role="button"><i class="glyphicon glyphicon-pencil"></i> <small>Edit this page</small></a></div>
</div>
- <p>Accumulo is often used as part of a larger data processing and storage system. To
-maximize the performance of a parallel system involving Accumulo, the ingestion
-and query components should be designed to provide enough parallelism and
-concurrency to avoid creating bottlenecks for users and other systems writing to
-and reading from Accumulo. There are several ways to achieve high ingest
-performance.</p>
-
-<h2 id="pre-splitting-new-tables">Pre-Splitting New Tables</h2>
-
-<p>New tables consist of a single tablet by default. As mutations are applied, the table
-grows and splits into multiple tablets which are balanced by the Master across
-TabletServers. This implies that the aggregate ingest rate will be limited to fewer
-servers than are available within the cluster until the table has reached the point
-where there are tablets on every TabletServer.</p>
-
-<p>Pre-splitting a table ensures that there are as many tablets as desired available
-before ingest begins to take advantage of all the parallelism possible with the cluster
-hardware. Tables can be split at any time by using the shell:</p>
-
-<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>user@myinstance mytable> addsplits -sf /local_splitfile -t mytable
+ <p><a href="https://spark.apache.org/">Apache Spark</a> applications can read and write from Accumulo tables.</p>
+
+<p>Before reading this documentation, it may help to review the <a href="/docs/2.x/development/mapreduce">MapReduce</a>
+documentation as API created for MapReduce jobs is used by Spark.</p>
+
+<p>This documentation references code from the Accumulo <a href="https://github.com/apache/accumulo-examples/tree/master/spark">Spark example</a>.</p>
+
+<h2 id="general-configuration">General configuration</h2>
+
+<ol>
+ <li>
+ <p>Create a <a href="https://maven.apache.org/plugins/maven-shade-plugin/index.html">shaded jar</a> with your Spark code and all of your dependencies (excluding
+Spark and Hadoop). When creating the shaded jar, you should relocate Guava
+as Accumulo uses a different version. The <a href="https://github.com/apache/accumulo-examples/blob/master/pom.xml">pom.xml</a> in the <a href="https://github.com/apache/accumulo-examples/tree/master/spark">Spark example</a> is
+a good reference and can be used a a starting point for a Spark application.</p>
+ </li>
+ <li>
+ <p>Submit the job by running <code class="highlighter-rouge">spark-submit</code> with your shaded jar. You should pass
+in the location of your <code class="highlighter-rouge">accumulo-client.properties</code> that will be used to connect
+to your Accumulo instance.</p>
+ <div class="language-bash highlighter-rouge"><div class="highlight"><pre class="highlight"><code> <span class="nv">$SPARK_HOME</span>/bin/spark-submit <span class="se">\</span>
+ <span class="nt">--class</span> com.my.spark.job.MainClass <span class="se">\</span>
+ <span class="nt">--master</span> yarn <span class="se">\</span>
+ <span class="nt">--deploy-mode</span> client <span class="se">\</span>
+ /path/to/spark-job-shaded.jar <span class="se">\</span>
+ /path/to/accumulo-client.properties
+</code></pre></div> </div>
+ </li>
+</ol>
+
+<h2 id="reading-from-accumulo-table">Reading from Accumulo table</h2>
+
+<p>Apache Spark can read from an Accumulo table by using <a href="https://static.javadoc.io/org.apache.accumulo/accumulo-hadoop-mapreduce/2.0.0-alpha-2/org/apache/accumulo/hadoop/mapreduce/AccumuloInputFormat.html">AccumuloInputFormat</a>.</p>
+
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="n">Job</span> <span class="n">job</span> <span class="o">=</span> <span class="n">Job</span><span class="o">.</span><span class="na">getInstance</span><span class="o">();</span>
+<span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="na">configure</span><span class="o">().</span><span class="na">clientProperties</span><span class="o">(</span><span class="n">props</span><span class="o">).</span><span class="na">table</span><span class="o">(</span><span class="n">inputTable</span><span class="o">).</span><span class="na">store</span><span class="o">(</span><span class="n">job</span><span class="o">);</span>
+<span class="n">JavaPairRDD</span><span class="o"><</span><span class="n">Key</span><span class="o">,</span><span class="n">Value</span><span class="o">></span> <span class="n">data</span> <span class="o">=</span> <span class="n">sc</span><span class="o">.</span><span class="na">newAPIHadoopRDD</span><span class="o">(</span><span class="n">job</span><span class="o">.</span><span class="na">getConfiguration</span><span class="o">(),</span>
+ <span class="n">AccumuloInputFormat</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="n">Key</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="n">Value</span><span class="o">.</span><span class="na">class</span><span class="o">);</span>
</code></pre></div></div>
-<p>For the purposes of providing parallelism to ingest it is not necessary to create more
-tablets than there are physical machines within the cluster as the aggregate ingest
-rate is a function of the number of physical machines. Note that the aggregate ingest
-rate is still subject to the number of machines running ingest clients, and the
-distribution of rowIDs across the table. The aggregation ingest rate will be
-suboptimal if there are many inserts into a small number of rowIDs.</p>
-
-<h2 id="multiple-ingest-clients">Multiple Ingest Clients</h2>
-
-<p>Accumulo is capable of scaling to very high rates of ingest, which is dependent upon
-not just the number of TabletServers in operation but also the number of ingest
-clients. This is because a single client, while capable of batching mutations and
-sending them to all TabletServers, is ultimately limited by the amount of data that
-can be processed on a single machine. The aggregate ingest rate will scale linearly
-with the number of clients up to the point at which either the aggregate I/O of
-TabletServers or total network bandwidth capacity is reached.</p>
-
-<p>In operational settings where high rates of ingest are paramount, clusters are often
-configured to dedicate some number of machines solely to running Ingester Clients.
-The exact ratio of clients to TabletServers necessary for optimum ingestion rates
-will vary according to the distribution of resources per machine and by data type.</p>
-
-<h2 id="bulk-ingest">Bulk Ingest</h2>
-
-<p>Accumulo supports the ability to import files produced by an external process such
-as MapReduce into an existing table. In some cases it may be faster to load data this
-way rather than via ingesting through clients using BatchWriters. This allows a large
-number of machines to format data the way Accumulo expects. The new files can
-then simply be introduced to Accumulo via a shell command.</p>
-
-<p>To configure MapReduce to format data in preparation for bulk loading, the job
-should be set to use a range partitioner instead of the default hash partitioner. The
-range partitioner uses the split points of the Accumulo table that will receive the
-data. The split points can be obtained from the shell and used by the MapReduce
-RangePartitioner. Note that this is only useful if the existing table is already split
-into multiple tablets.</p>
-
-<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>user@myinstance mytable> getsplits
-aa
-ab
-ac
-...
-zx
-zy
-zz
+<h2 id="writing-to-accumulo-table">Writing to Accumulo table</h2>
+
+<p>There are two ways to write an Accumulo table.</p>
+
+<h3 id="use-a-batchwriter">Use a BatchWriter</h3>
+
+<p>Write your data to Accumulo by creating an AccumuloClient for each partition and writing all
+data in the partition using a BatchWriter.</p>
+
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="c1">// Spark will automatically serialize this properties object and send it to each partition</span>
+<span class="n">Properties</span> <span class="n">props</span> <span class="o">=</span> <span class="n">Accumulo</span><span class="o">.</span><span class="na">newClientProperties</span><span class="o">()</span>
+ <span class="o">.</span><span class="na">from</span><span class="o">(</span><span class="s">"/path/to/accumulo-client.properties"</span><span class="o">).</span><span class="na">build</span><span class="o">();</span>
+<span class="n">JavaPairRDD</span><span class="o"><</span><span class="n">Key</span><span class="o">,</span> <span class="n">Value</span><span class="o">></span> <span class="n">dataToWrite</span> <span class="o">=</span> <span class="o">...</span> <span class="o">;</span>
+<span class="n">dataToWrite</span><span class="o">.</span><span class="na">foreachPartition</span><span class="o">(</span><span class="n">iter</span> <span class="o">-></span> <span class="o">{</span>
+ <span class="c1">// Create client inside partition so that Spark does not attempt to serialize it.</span>
+ <span class="k">try</span> <span class="o">(</span><span class="n">AccumuloClient</span> <span class="n">client</span> <span class="o">=</span> <span class="n">Accumulo</span><span class="o">.</span><span class="na">newClient</span><span class="o">().</span><span class="na">from</span><span class="o">(</span><span class="n">props</span><span class="o">).</span><span class="na">build</span><span class="o">();</span>
+ <span class="n">BatchWriter</span> <span class="n">bw</span> <span class="o">=</span> <span class="n">client</span><span class="o">.</span><span class="na">createBatchWriter</span><span class="o">(</span><span class="n">outputTable</span><span class="o">))</span> <span class="o">{</span>
+ <span class="n">iter</span><span class="o">.</span><span class="na">forEachRemaining</span><span class="o">(</span><span class="n">kv</span> <span class="o">-></span> <span class="o">{</span>
+ <span class="n">Key</span> <span class="n">key</span> <span class="o">=</span> <span class="n">kv</span><span class="o">.</span><span class="na">_1</span><span class="o">;</span>
+ <span class="n">Value</span> <span class="n">val</span> <span class="o">=</span> <span class="n">kv</span><span class="o">.</span><span class="na">_2</span><span class="o">;</span>
+ <span class="n">Mutation</span> <span class="n">m</span> <span class="o">=</span> <span class="k">new</span> <span class="n">Mutation</span><span class="o">(</span><span class="n">key</span><span class="o">.</span><span class="na">getRow</span><span class="o">());</span>
+ <span class="n">m</span><span class="o">.</span><span class="na">at</span><span class="o">().</span><span class="na">family</span><span class="o">(</span><span class="n">key</span><span class="o">.</span><span class="na">getColumnFamily</span><span class="o">()).</span><span class="na">qualifier</span><span class="o">(</span><span class="n">key</span><span class="o">.</span><span class="na">getColumnQualifier</span><span class="o">())</span>
+ <span class="o">.</span><span class="na">visibility</span><span class="o">(</span><span class="n">key</span><span class="o">.</span><span class="na">getColumnVisibility</span><span class="o">()).</span><span class="na">timestamp</span><span class="o">(</span><span class="n">key</span><span class="o">.</span><span class="na">getTimestamp</span><span class="o">()).</span><span class="na">put</span><span class="o">(</span><span class="n">val</span><span class="o">);</span>
+ <span class="n">bw</span><span class="o">.</span><span class="na">addMutation</span><span class="o">(</span><span class="n">m</span><span class="o">);</span>
+ <span class="o">});</span>
+ <span class="o">}</span>
+<span class="o">});</span>
</code></pre></div></div>
-<p>Run the MapReduce job, using the <a href="https://static.javadoc.io/org.apache.accumulo/accumulo-hadoop-mapreduce/2.0.0-alpha-2/org/apache/accumulo/hadoop/mapreduce/AccumuloFileOutputFormat.html">AccumuloFileOutputFormat</a> to create the files to
-be introduced to Accumulo. Once this is complete, the files can be added to
-Accumulo via the shell:</p>
-
-<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>user@myinstance mytable> importdirectory /files_dir /failures
+<h3 id="using-bulk-import">Using Bulk Import</h3>
+
+<p>Partition your data and write it to RFiles. The <a href="https://github.com/apache/accumulo-examples/blob/master/spark/src/main/java/org/apache/accumulo/spark/CopyPlus5K.java#L44">AccumuloRangePartitioner</a> found in the Accumulo
+Spark example can be used for partitioning data. After your data has been written to an output
+directory using <a href="https://static.javadoc.io/org.apache.accumulo/accumulo-hadoop-mapreduce/2.0.0-alpha-2/org/apache/accumulo/hadoop/mapreduce/AccumuloFileOutputFormat.html">AccumuloFileOutputFormat</a> as RFiles, bulk import this directory into Accumulo.</p>
+
+<div class="language-java highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="c1">// Write Spark output to HDFS</span>
+<span class="n">JavaPairRDD</span><span class="o"><</span><span class="n">Key</span><span class="o">,</span> <span class="n">Value</span><span class="o">></span> <span class="n">dataToWrite</span> <span class="o">=</span> <span class="o">...</span> <span class="o">;</span>
+<span class="n">Job</span> <span class="n">job</span> <span class="o">=</span> <span class="n">Job</span><span class="o">.</span><span class="na">getInstance</span><span class="o">();</span>
+<span class="n">AccumuloFileOutputFormat</span><span class="o">.</span><span class="na">configure</span><span class="o">().</span><span class="na">outputPath</span><span class="o">(</span><span class="n">outputDir</span><span class="o">).</span><span class="na">store</span><span class="o">(</span><span class="n">job</span><span class="o">);</span>
+<span class="n">Partitioner</span> <span class="n">partitioner</span> <span class="o">=</span> <span class="k">new</span> <span class="n">AccumuloRangePartitioner</span><span class="o">(</span><span class="s">"3"</span><span class="o">,</span> <span class="s">"7"</span><span class="o">);</span>
+<span class="n">JavaPairRDD</span><span class="o"><</span><span class="n">Key</span><span class="o">,</span> <span class="n">Value</span><span class="o">></span> <span class="n">partData</span> <span class="o">=</span> <span class="n">dataPlus5K</span><span class="o">.</span><span class="na">repartitionAndSortWithinPartitions</span><span class="o">(</span><span class="n">partitioner</span><span class="o">);</span>
+<span class="n">partData</span><span class="o">.</span><span class="na">saveAsNewAPIHadoopFile</span><span class="o">(</span><span class="n">outputDir</span><span class="o">.</span><span class="na">toString</span><span class="o">(),</span> <span class="n">Key</span><span class="o">.</span><span class="na">class</span><span class="o">,</span> <span class="n">Value</span><span class="o">.</span><span class="na">class</span><span class="o">,</span>
+ <span class="n">AccumuloFileOutputFormat</span><span class="o">.</span><span class="na">class</span><span class="o">);</span>
+
+<span class="c1">// Bulk import RFiles in HDFS into Accumulo</span>
+<span class="k">try</span> <span class="o">(</span><span class="n">AccumuloClient</span> <span class="n">client</span> <span class="o">=</span> <span class="n">Accumulo</span><span class="o">.</span><span class="na">newClient</span><span class="o">().</span><span class="na">from</span><span class="o">(</span><span class="n">props</span><span class="o">).</span><span class="na">build</span><span class="o">())</span> <span class="o">{</span>
+ <span class="n">client</span><span class="o">.</span><span class="na">tableOperations</span><span class="o">().</span><span class="na">importDirectory</span><span class="o">(</span><span class="n">outputDir</span><span class="o">.</span><span class="na">toString</span><span class="o">()).</span><span class="na">to</span><span class="o">(</span><span class="n">outputTable</span><span class="o">).</span><span class="na">load</span><span class="o">();</span>
+<span class="o">}</span>
</code></pre></div></div>
-<p>Note that the paths referenced are directories within the same HDFS instance over
-which Accumulo is running. Accumulo places any files that failed to be added to the
-second directory specified.</p>
-
-<p>See the <a href="https://github.com/apache/accumulo-examples/blob/master/docs/bulkIngest.md">bulk ingest example</a> for a complete example.</p>
-
-<h2 id="logical-time-for-bulk-ingest">Logical Time for Bulk Ingest</h2>
-
-<p>Logical time is important for bulk imported data, for which the client code may
-be choosing a timestamp. At bulk import time, the user can choose to enable
-logical time for the set of files being imported. When its enabled, Accumulo
-uses a specialized system iterator to lazily set times in a bulk imported file.
-This mechanism guarantees that times set by unsynchronized multi-node
-applications (such as those running on MapReduce) will maintain some semblance
-of causal ordering. This mitigates the problem of the time being wrong on the
-system that created the file for bulk import. These times are not set when the
-file is imported, but whenever it is read by scans or compactions. At import, a
-time is obtained and always used by the specialized system iterator to set that
-time.</p>
-
-<p>The timestamp assigned by Accumulo will be the same for every key in the file.
-This could cause problems if the file contains multiple keys that are identical
-except for the timestamp. In this case, the sort order of the keys will be
-undefined. This could occur if an insert and an update were in the same bulk
-import file.</p>
-
-<h2 id="mapreduce-ingest">MapReduce Ingest</h2>
+<h2 id="reference">Reference</h2>
-<p>It is possible to efficiently write many mutations to Accumulo in parallel via a
-MapReduce job. Typically, a MapReduce job will process data that lives in HDFS
-and write mutations to Accumulo using <a href="https://static.javadoc.io/org.apache.accumulo/accumulo-hadoop-mapreduce/2.0.0-alpha-2/org/apache/accumulo/hadoop/mapreduce/AccumuloOutputFormat.html">AccumuloOutputFormat</a>. For more information
-on how use to use MapReduce with Accumulo, see the <a href="/docs/2.x/development/mapreduce">MapReduce documentation</a>.</p>
+<ul>
+ <li><a href="https://github.com/apache/accumulo-examples/tree/master/spark">Spark example</a> - Accumulo example application that uses Spark to read & write from Accumulo</li>
+ <li><a href="/docs/2.x/development/mapreduce">MapReduce</a> - Documentation on reading/writing to Accumulo using MapReduce</li>
+ <li><a href="https://spark.apache.org/">Apache Spark</a> - Spark project website</li>
+</ul>
<div class="row" style="margin-top: 20px;">
<div class="col-md-10"><strong>Find documentation for all releases in the <a href="/docs-archive">archive</strong></div>
- <div class="col-md-2"><a class="pull-right" href="https://github.com/apache/accumulo-website/edit/master/_docs-2/development/high_speed_ingest.md" role="button"><i class="glyphicon glyphicon-pencil"></i> <small>Edit this page</small></a></div>
+ <div class="col-md-2"><a class="pull-right" href="https://github.com/apache/accumulo-website/edit/master/_docs-2/development/spark.md" role="button"><i class="glyphicon glyphicon-pencil"></i> <small>Edit this page</small></a></div>
</div>
</div>
</div>
diff --git a/docs/2.x/development/summaries.html b/docs/2.x/development/summaries.html
index b0fb805..75b3b71 100644
--- a/docs/2.x/development/summaries.html
+++ b/docs/2.x/development/summaries.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link doc-sidebar-selected"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/clients.html b/docs/2.x/getting-started/clients.html
index a23e79e..eeca49d 100644
--- a/docs/2.x/getting-started/clients.html
+++ b/docs/2.x/getting-started/clients.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/design.html b/docs/2.x/getting-started/design.html
index d3ddb25..a839981 100644
--- a/docs/2.x/getting-started/design.html
+++ b/docs/2.x/getting-started/design.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/features.html b/docs/2.x/getting-started/features.html
index 115a940..928644b 100644
--- a/docs/2.x/getting-started/features.html
+++ b/docs/2.x/getting-started/features.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/glossary.html b/docs/2.x/getting-started/glossary.html
index bd1c1a9..63d0f90 100644
--- a/docs/2.x/getting-started/glossary.html
+++ b/docs/2.x/getting-started/glossary.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/quickstart.html b/docs/2.x/getting-started/quickstart.html
index 4356974..39e2d5b 100644
--- a/docs/2.x/getting-started/quickstart.html
+++ b/docs/2.x/getting-started/quickstart.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/shell.html b/docs/2.x/getting-started/shell.html
index a114dee..ff3e20e 100644
--- a/docs/2.x/getting-started/shell.html
+++ b/docs/2.x/getting-started/shell.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/table_configuration.html b/docs/2.x/getting-started/table_configuration.html
index c931d08..1fb2c82 100644
--- a/docs/2.x/getting-started/table_configuration.html
+++ b/docs/2.x/getting-started/table_configuration.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/getting-started/table_design.html b/docs/2.x/getting-started/table_design.html
index 51c9e4c..7697e84 100644
--- a/docs/2.x/getting-started/table_design.html
+++ b/docs/2.x/getting-started/table_design.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/authentication.html b/docs/2.x/security/authentication.html
index 70233b0..bd1b7f3 100644
--- a/docs/2.x/security/authentication.html
+++ b/docs/2.x/security/authentication.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/authorizations.html b/docs/2.x/security/authorizations.html
index 4c33b99..601e3fb 100644
--- a/docs/2.x/security/authorizations.html
+++ b/docs/2.x/security/authorizations.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/kerberos.html b/docs/2.x/security/kerberos.html
index 9c919c4..6fe38ea 100644
--- a/docs/2.x/security/kerberos.html
+++ b/docs/2.x/security/kerberos.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/on-disk-encryption.html b/docs/2.x/security/on-disk-encryption.html
index 0470b81..d9c3ca3 100644
--- a/docs/2.x/security/on-disk-encryption.html
+++ b/docs/2.x/security/on-disk-encryption.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/overview.html b/docs/2.x/security/overview.html
index a5c6512..8d43774 100644
--- a/docs/2.x/security/overview.html
+++ b/docs/2.x/security/overview.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/permissions.html b/docs/2.x/security/permissions.html
index 36608fc..92dbc8b 100644
--- a/docs/2.x/security/permissions.html
+++ b/docs/2.x/security/permissions.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/security/wire-encryption.html b/docs/2.x/security/wire-encryption.html
index 5f4a060..af31c10 100644
--- a/docs/2.x/security/wire-encryption.html
+++ b/docs/2.x/security/wire-encryption.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/troubleshooting/advanced.html b/docs/2.x/troubleshooting/advanced.html
index a75a116..801531f 100644
--- a/docs/2.x/troubleshooting/advanced.html
+++ b/docs/2.x/troubleshooting/advanced.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/troubleshooting/basic.html b/docs/2.x/troubleshooting/basic.html
index 7816e14..8f474ce 100644
--- a/docs/2.x/troubleshooting/basic.html
+++ b/docs/2.x/troubleshooting/basic.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/troubleshooting/performance.html b/docs/2.x/troubleshooting/performance.html
index 2b0da31..3fbe176 100644
--- a/docs/2.x/troubleshooting/performance.html
+++ b/docs/2.x/troubleshooting/performance.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/troubleshooting/system-metadata-tables.html b/docs/2.x/troubleshooting/system-metadata-tables.html
index 1a11cc8..6a574b4 100644
--- a/docs/2.x/troubleshooting/system-metadata-tables.html
+++ b/docs/2.x/troubleshooting/system-metadata-tables.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/troubleshooting/tools.html b/docs/2.x/troubleshooting/tools.html
index 0c148c2..1eb23a7 100644
--- a/docs/2.x/troubleshooting/tools.html
+++ b/docs/2.x/troubleshooting/tools.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/docs/2.x/troubleshooting/tracing.html b/docs/2.x/troubleshooting/tracing.html
index 4f6d38b..e52a49a 100644
--- a/docs/2.x/troubleshooting/tracing.html
+++ b/docs/2.x/troubleshooting/tracing.html
@@ -210,7 +210,7 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/mapreduce">MapReduce </a></div>
- <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/spark">Spark </a></div>
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/development_tools">Development Tools </a></div>
@@ -218,6 +218,8 @@
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/summaries">Summary Statistics </a></div>
+ <div class="row doc-sidebar-link"><a href="/docs/2.x/development/proxy">Proxy </a></div>
+
<div class="row doc-sidebar-link"><a href="/docs/2.x/development/high_speed_ingest">High-Speed Ingest </a></div>
</div>
diff --git a/feed.xml b/feed.xml
index e11524d..51a9d7c 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
</description>
<link>https://accumulo.apache.org/</link>
<atom:link href="https://accumulo.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Tue, 23 Apr 2019 15:21:26 -0400</pubDate>
- <lastBuildDate>Tue, 23 Apr 2019 15:21:26 -0400</lastBuildDate>
+ <pubDate>Wed, 24 Apr 2019 17:53:32 -0400</pubDate>
+ <lastBuildDate>Wed, 24 Apr 2019 17:53:32 -0400</lastBuildDate>
<generator>Jekyll v3.7.3</generator>
diff --git a/search_data.json b/search_data.json
index 292350d..3f811cd 100644
--- a/search_data.json
+++ b/search_data.json
@@ -126,6 +126,13 @@
"categories": "development"
},
+ "docs-2-x-development-spark": {
+ "title": "Spark",
+ "content" : "Apache Spark applications can read and write from Accumulo tables.Before reading this documentation, it may help to review the MapReducedocumentation as API created for MapReduce jobs is used by Spark.This documentation references code from the Accumulo Spark example.General configuration Create a shaded jar with your Spark code and all of your dependencies (excludingSpark and Hadoop). When creating the shaded jar, you should relocate Guavaas Accumulo uses a diff [...]
+ "url": " /docs/2.x/development/spark",
+ "categories": "development"
+ },
+
"docs-2-x-development-summaries": {
"title": "Summary Statistics",
"content" : "OverviewAccumulo has the ability to generate summary statistics about data in a tableusing user defined functions. Currently these statistics are only generated fordata written to files. Data recently written to Accumulo that is still inmemory will not contribute to summary statistics.This feature can be used to inform a user about what data is in their table.Summary statistics can also be used by compaction strategies to make decisionsabout which files to compact.S [...]