You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@accumulo.apache.org by el...@apache.org on 2013/12/02 18:47:28 UTC
[1/2] git commit: ACCUMULO-1946 Note in the README about
dfs.datanode.synconclose.
Updated Branches:
refs/heads/1.6.0-SNAPSHOT 9b6b9cf10 -> 29223f796
ACCUMULO-1946 Note in the README about dfs.datanode.synconclose.
Project: http://git-wip-us.apache.org/repos/asf/accumulo/repo
Commit: http://git-wip-us.apache.org/repos/asf/accumulo/commit/0fd190b6
Tree: http://git-wip-us.apache.org/repos/asf/accumulo/tree/0fd190b6
Diff: http://git-wip-us.apache.org/repos/asf/accumulo/diff/0fd190b6
Branch: refs/heads/1.6.0-SNAPSHOT
Commit: 0fd190b602ab88458e9932b8467a17c8e8201d09
Parents: 27c1d77
Author: Josh Elser <el...@apache.org>
Authored: Mon Dec 2 12:43:58 2013 -0500
Committer: Josh Elser <el...@apache.org>
Committed: Mon Dec 2 12:43:58 2013 -0500
----------------------------------------------------------------------
README | 4 ++++
1 file changed, 4 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/accumulo/blob/0fd190b6/README
----------------------------------------------------------------------
diff --git a/README b/README
index 4b29864..ab6f3fc 100644
--- a/README
+++ b/README
@@ -94,6 +94,10 @@ Cloudera CDH 3u4 dfs.support.append true
Hortonworks HDP `1.0 dfs.support.append false
Hortonworks HDP `1.1 dfs.support.append false
+Additionally, it is strongly recommended that you enable 'dfs.datanode.synconclose'
+in your hdfs-site.xml configuration file to ensure that, in the face of unexpected
+power loss to a datanode, files are wholly synced to disk.
+
The example accumulo configuration files are placed in directories based on the
memory footprint for the accumulo processes. If you are using native libraries
for you tablet server in-memory map, then you can use the files in "native-standalone".
[2/2] git commit: Merge branch '1.5.1-SNAPSHOT' into 1.6.0-SNAPSHOT
Posted by el...@apache.org.
Merge branch '1.5.1-SNAPSHOT' into 1.6.0-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/accumulo/repo
Commit: http://git-wip-us.apache.org/repos/asf/accumulo/commit/29223f79
Tree: http://git-wip-us.apache.org/repos/asf/accumulo/tree/29223f79
Diff: http://git-wip-us.apache.org/repos/asf/accumulo/diff/29223f79
Branch: refs/heads/1.6.0-SNAPSHOT
Commit: 29223f796dbac1d74818bd71db81906e8040c077
Parents: 9b6b9cf 0fd190b
Author: Josh Elser <el...@apache.org>
Authored: Mon Dec 2 12:45:48 2013 -0500
Committer: Josh Elser <el...@apache.org>
Committed: Mon Dec 2 12:45:48 2013 -0500
----------------------------------------------------------------------
README | 4 ++++
1 file changed, 4 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/accumulo/blob/29223f79/README
----------------------------------------------------------------------
diff --cc README
index b18ab6c,ab6f3fc..70bc18e
--- a/README
+++ b/README
@@@ -129,16 -81,23 +129,20 @@@ You will need to have hadoop installed
you must enable HDFS durable sync. How you enable this depends on your version
of Hadoop. Please consult the table below for information regarding your version.
If you need to set the coniguration, please be sure to restart HDFS. See
-ACCUMULO-623 for more information.
-
-HADOOP RELEASE VERSION SYNC NAME DEFAULT
-Apache Hadoop 0.20.205 dfs.support.append false
-Apache Hadoop 0.23.x dfs.support.append true
-Apache Hadoop 1.0.x dfs.support.append false
-Apache Hadoop 1.1.x dfs.durable.sync true
-Apache Hadoop 2.0.0-2.0.4 dfs.support.append true
-Cloudera CDH 3u0-3u3 ???? true
-Cloudera CDH 3u4 dfs.support.append true
-Hortonworks HDP `1.0 dfs.support.append false
-Hortonworks HDP `1.1 dfs.support.append false
+ACCUMULO-623 and ACCUMULO-1637 for more information.
+
+The following releases of Apache Hadoop require special configuration to ensure
+that data is not inadvertently lost; however, in all releases of Apache Hadoop,
+`dfs.durable.sync` and `dfs.support.append` should *not* be configured as `false`.
+
+VERSION NAME=VALUE
+0.20.205.0 - dfs.support.append=true
+1.0.x - dfs.support.append=true
+ Additionally, it is strongly recommended that you enable 'dfs.datanode.synconclose'
+ in your hdfs-site.xml configuration file to ensure that, in the face of unexpected
+ power loss to a datanode, files are wholly synced to disk.
+
The example accumulo configuration files are placed in directories based on the
memory footprint for the accumulo processes. If you are using native libraries
for you tablet server in-memory map, then you can use the files in "native-standalone".