You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@accumulo.apache.org by kt...@apache.org on 2018/10/14 19:22:56 UTC
[accumulo-website] branch asf-site updated: Jekyll build from
master:65a48e6
This is an automated email from the ASF dual-hosted git repository.
kturner pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/accumulo-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e03e3ef Jekyll build from master:65a48e6
e03e3ef is described below
commit e03e3ef5a1ea277685f2370a56822015d3681c3a
Author: Keith Turner <kt...@apache.org>
AuthorDate: Sun Oct 14 15:22:40 2018 -0400
Jekyll build from master:65a48e6
Improved 2.0 release notes and added issue liquid tags
---
README.md | 2 ++
docs/2.0/administration/crypto.html | 10 +++---
feed.xml | 4 +--
redirects.json | 2 +-
release/accumulo-2.0.0/index.html | 63 +++++++++++++++++++++++++++++++++----
search_data.json | 4 +--
6 files changed, 68 insertions(+), 17 deletions(-)
diff --git a/README.md b/README.md
index 11f139d..cca86c5 100644
--- a/README.md
+++ b/README.md
@@ -48,6 +48,8 @@ The source for these tags is at [_plugins/links.rb](_plugins/links.rb).
| purl | Creates Property URL | Default is server property. Use `-c` to link to client properties. Accepts server property prefixes (i.e `table.*`) | `{% purl instance.volumes %}` |
| dlink | Creates Documentation link | None | `{% dlink getting-stared/clients %}` |
| durl | Creates Documentation URL | None | `{% durl troubleshooting/performance %}` |
+| ghi | GitHub issue link | None | `{% ghi 100 %}` |
+| jira | Jira issue link | None | `{% jira ACCUMULO-1000 %}` |
## Updating property documentation
diff --git a/docs/2.0/administration/crypto.html b/docs/2.0/administration/crypto.html
index a65c6b1..3c3a324 100644
--- a/docs/2.0/administration/crypto.html
+++ b/docs/2.0/administration/crypto.html
@@ -356,13 +356,11 @@ class name of the service which will perform crypto on RFiles and WALs.</p>
<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>instance.crypto.service=org.apache.accumulo.core.security.crypto.impl.AESCryptoService
</code></pre></div></div>
<p>Out of the box, Accumulo provides the <code class="highlighter-rouge">AESCryptoService</code> for basic encryption needs. This class provides AES encryption
-with Galois/Counter Mode (GCM) for RFiles and Cipher Block Chaining (CBC) mode for WALs. The additional properties
-below are required by this crypto service to be set using the <a href="/docs/2.0/administration/properties#instance_crypto_opts_prefix">instance.crypto.opts.*</a> prefix.</p>
-<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>instance.crypto.opts.key.provider=uri
-instance.crypto.opts.key.location=file:///secure/path/to/crypto-key-file
+with Galois/Counter Mode (GCM) for RFiles and Cipher Block Chaining (CBC) mode for WALs. The additional property
+below is required by this crypto service to be set using the <a href="/docs/2.0/administration/properties#instance_crypto_opts_prefix">instance.crypto.opts.*</a> prefix.</p>
+<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>instance.crypto.opts.key.location=file:///secure/path/to/crypto-key-file
</code></pre></div></div>
-<p>The first property tells the crypto service how it will get the key encryption key. The second property tells the service
-where to find the key. For now, the only valid values are “uri” and the path to the key file. The key file can be 16 or 32 bytes.
+<p>This property tells the crypto service where to find the file containing the key encryption key. The key file can be 16 or 32 bytes.
For example, openssl can be used to create a random 32 byte key:</p>
<div class="highlighter-rouge"><div class="highlight"><pre class="highlight"><code>openssl rand -out /path/to/keyfile 32
</code></pre></div></div>
diff --git a/feed.xml b/feed.xml
index ff74fc4..52b225f 100644
--- a/feed.xml
+++ b/feed.xml
@@ -6,8 +6,8 @@
</description>
<link>https://accumulo.apache.org/</link>
<atom:link href="https://accumulo.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Tue, 09 Oct 2018 18:36:12 -0400</pubDate>
- <lastBuildDate>Tue, 09 Oct 2018 18:36:12 -0400</lastBuildDate>
+ <pubDate>Sun, 14 Oct 2018 15:22:35 -0400</pubDate>
+ <lastBuildDate>Sun, 14 Oct 2018 15:22:35 -0400</lastBuildDate>
<generator>Jekyll v3.7.3</generator>
diff --git a/redirects.json b/redirects.json
index 2ec52c0..1bc038b 100644
--- a/redirects.json
+++ b/redirects.json
@@ -1 +1 @@
-{"/release_notes/1.5.1.html":"https://accumulo.apache.org/release/accumulo-1.5.1/","/release_notes/1.6.0.html":"https://accumulo.apache.org/release/accumulo-1.6.0/","/release_notes/1.6.1.html":"https://accumulo.apache.org/release/accumulo-1.6.1/","/release_notes/1.6.2.html":"https://accumulo.apache.org/release/accumulo-1.6.2/","/release_notes/1.7.0.html":"https://accumulo.apache.org/release/accumulo-1.7.0/","/release_notes/1.5.3.html":"https://accumulo.apache.org/release/accumulo-1.5.3/" [...]
\ No newline at end of file
+{"/release_notes/1.5.1.html":"https://accumulo.apache.org/release/accumulo-1.5.1/","/release_notes/1.6.0.html":"https://accumulo.apache.org/release/accumulo-1.6.0/","/release_notes/1.6.1.html":"https://accumulo.apache.org/release/accumulo-1.6.1/","/release_notes/1.6.2.html":"https://accumulo.apache.org/release/accumulo-1.6.2/","/release_notes/1.7.0.html":"https://accumulo.apache.org/release/accumulo-1.7.0/","/release_notes/1.5.3.html":"https://accumulo.apache.org/release/accumulo-1.5.3/" [...]
\ No newline at end of file
diff --git a/release/accumulo-2.0.0/index.html b/release/accumulo-2.0.0/index.html
index fb99779..19442a2 100644
--- a/release/accumulo-2.0.0/index.html
+++ b/release/accumulo-2.0.0/index.html
@@ -163,7 +163,10 @@
-<p>Apache Accumulo 2.0.0 is a significant release.</p>
+<p>Apache Accumulo 2.0.0 is a significant release. These release notes are still a work in
+progress. The notes are fairly complete in terms of features added to 2.0, but some
+features may still be missing. Also, the notes will be updated in the future to point
+to documentation for new features in addition to issues.</p>
<h2 id="notable-changes">Notable Changes</h2>
@@ -174,6 +177,12 @@ The new API deprecates <code class="highlighter-rouge">ClientConfiguration</code
file called <code class="highlighter-rouge">accumulo-client.properties</code> that ships with the Accumulo tarball.
See the <a href="/docs/2.0/getting-started/clients">client documentation</a> for more information on how to use the new API.</p>
+<h3 id="hadoop-3-and-java-8">Hadoop 3 and Java 8.</h3>
+
+<p>Accumulo 2.x expects at least Java 8 and Hadoop 3. It is built against Java 8
+and Hadoop 3 and the binary tarball is targeted to work with a Java 8 and
+Hadoop 3 system. See <a href="https://issues.apache.org/jira/browse/ACCUMULO-4826">ACCUMULO-4826 </a>, <a href="https://github.com/apache/accumulo/issues/531">#531 </a>, and <a href="https://issues.apache.org/jira/browse/ACCUMULO-4299">ACCUMULO-4299 </a>.</p>
+
<h3 id="simplified-accumulo-scripts-and-configuration-files">Simplified Accumulo scripts and configuration files</h3>
<p>Accumulo’s scripts and configuration were refactored in <a href="https://issues.apache.org/jira/browse/ACCUMULO-4490">ACCUMULO-4490</a> to make Accumulo
@@ -189,17 +198,47 @@ has been reduced from 20 scripts to the four scripts below:</p>
<p>Read <a href="/blog/2016/11/16/simpler-scripts-and-config.html">this blog post</a> for more information on this change.</p>
+<h3 id="new-bulk-import-api">New Bulk Import API</h3>
+
+<p>A new bulk import API was added in 2.0 that has very different implementation. This new API supports the following new functionality.</p>
+
+<ul>
+ <li>Bulk import to an offline table.</li>
+ <li>Load plans that specify where files go in a table which avoids opening the
+files for inspection.</li>
+ <li>Inspection of file on the client side. Inspection of all files is done
+before the FATE operation starts. This results in less namenode operations
+and fail-fast for bad files (no longer need a fail directory).</li>
+ <li>A new improved algorithm to load files into tablets. This new algorithm
+scans the metadata table and makes asynchronous load calls to all tablets.
+This queues load operations on all tablets at around the same time. The
+async RPC calls and beforehand inspection make the bulk load FATE operation
+much shorter.</li>
+</ul>
+
+<p>The shell command for doing bulk load supports the old and new API. To use the
+new API from the shell simply omit the failure directory argument.
+TODO link to javadoc for new API. See <a href="https://github.com/apache/accumulo/issues/436">#436 </a>, <a href="https://github.com/apache/accumulo/issues/472">#472 </a>, and <a href="https://github.com/apache/accumulo/issues/570">#570 </a>.</p>
+
+<h3 id="summaries">Summaries</h3>
+
+<p><a href="/docs/2.0/development/summaries">Summaries</a> enables continually generating
+statistics about a table with user defined functions. This feature can inform
+a user about what is in their table and be used by compaction strategies to
+make decisions. For example, using this feature it would be possible to compact
+all tablets where deletes are more than 25% of the data.</p>
+
<h3 id="scan-executors">Scan Executors</h3>
-<p><a href="/docs/2.0/administration/scan-executors">Scan executors</a> were added to
-support prioritizing and dedicating scan resources. Each executor has a
-configurable number of threads and an optional custom prioritizer. Tables can
-be configured in a flexible way to dispatch scans to different executors.</p>
+<p><a href="/docs/2.0/administration/scan-executors">Scan executors</a> support prioritizing
+and dedicating scan resources. Each executor has a configurable number of
+threads and an optional custom prioritizer. Tables can be configured in a
+flexible way to dispatch scans to different executors.</p>
<h3 id="official-accumulo-docker-image-was-created">Official Accumulo docker image was created</h3>
<p>An <a href="https://github.com/apache/accumulo-docker">official Accumulo docker images</a> was created in <a href="https://issues.apache.org/jira/browse/ACCUMULO-4706">ACCUMULO-4706</a> to make
-it easier for users to run Accumulo in Docker. To support running in Docker, a few changes were
+it easier for users to run Accumulo in Docker. To support running in Docker, a few changes were
made to Accumulo:</p>
<ul>
@@ -277,6 +316,18 @@ default to the value for crypto.cipher.suite.</li>
<li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4449">ACCUMULO-4449</a> - Removed ‘slave’ terminology and replaced with ‘tserver’ in
most cases. The former ‘slaves’ config file is now named ‘tservers’. Added checks to
scripts to fail if ‘slaves’ file is present.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4808">ACCUMULO-4808 </a> - Can now create table with splits and offline. Specifying splits
+at table creation time can be much faster than adding splits after creation.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4463">ACCUMULO-4463 </a> - Caching is now pluggable.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4177">ACCUMULO-4177 </a> - New built in cache implementation based on TinyLFU.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4376">ACCUMULO-4376 </a> <a href="https://issues.apache.org/jira/browse/ACCUMULO-4746">ACCUMULO-4746 </a> - Mutation and Key Fluent APIs allow easy mixing of types. For example a family of type <code class="highlighter-rouge">String</code> and qualifier of type <code class="highlighter-rouge">byte[]</code> is much easier to write using this new API.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4771">ACCUMULO-4771 </a> - The Accumulo monitor was completely rewritten.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4732">ACCUMULO-4732 </a> - Specify iterators and locality groups at table creation time.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-4612">ACCUMULO-4612 </a> - Use percentages for memory related configuration.</li>
+ <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1787">ACCUMULO-1787 </a> - Two tier compaction strategy. Support compacting small files with snappy and large files with gzip.</li>
+ <li><a href="https://github.com/apache/accumulo/issues/536">#536 </a> - Removed mock Accumulo.</li>
+ <li><a href="https://github.com/apache/accumulo/issues/438">#438 </a> - Added support for ZStandard compression</li>
+ <li><a href="https://github.com/apache/accumulo/issues/404">#404 </a> - Added basic Grafana dashboard example. TODO better link?</li>
</ul>
<h2 id="upgrading">Upgrading</h2>
diff --git a/search_data.json b/search_data.json
index b61992e..99ffebe 100644
--- a/search_data.json
+++ b/search_data.json
@@ -16,7 +16,7 @@
"docs-2-0-administration-crypto": {
"title": "On Disk Encryption",
- "content" : "For an additional layer of security, Accumulo can encrypt files stored on disk. On Disk encryption was reworked for 2.0, making it easier to configure and more secure. The files that can be encrypted include: RFiles and Write Ahead Logs (WALs).For information on encrypting data over the wire see the section on SSL. For information on cryptographic client-server authentication see the section on Kerberos.ConfigurationTo encrypt all tables on disk, encryption must be [...]
+ "content" : "For an additional layer of security, Accumulo can encrypt files stored on disk. On Disk encryption was reworked for 2.0, making it easier to configure and more secure. The files that can be encrypted include: RFiles and Write Ahead Logs (WALs).For information on encrypting data over the wire see the section on SSL. For information on cryptographic client-server authentication see the section on Kerberos.ConfigurationTo encrypt all tables on disk, encryption must be [...]
"url": " /docs/2.0/administration/crypto",
"categories": "administration"
},
@@ -320,7 +320,7 @@
"release-accumulo-2-0-0": {
"title": "Apache Accumulo 2.0.0",
- "content" : "Apache Accumulo 2.0.0 is a significant release.Notable ChangesNew API for creating connections to AccumuloA fluent API for clients to build Connector objects was introduced in ACCUMULO-4784.The new API deprecates ClientConfiguration and introduces its own propertiesfile called accumulo-client.properties that ships with the Accumulo tarball.See the client documentation for more information on how to use the new API.Simplified Accumulo scripts and configuration filesAcc [...]
+ "content" : "Apache Accumulo 2.0.0 is a significant release. These release notes are still a work inprogress. The notes are fairly complete in terms of features added to 2.0, but somefeatures may still be missing. Also, the notes will be updated in the future to pointto documentation for new features in addition to issues.Notable ChangesNew API for creating connections to AccumuloA fluent API for clients to build Connector objects was introduced in ACCUMULO-4784.The new API depr [...]
"url": " /release/accumulo-2.0.0/",
"categories": "release"
}