You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by ma...@apache.org on 2012/08/20 23:21:29 UTC
svn commit: r1375225 - in /hadoop/common/branches/branch-1.1: CHANGES.txt
src/docs/releasenotes.html
Author: mattf
Date: Mon Aug 20 21:21:28 2012
New Revision: 1375225
URL: http://svn.apache.org/viewvc?rev=1375225&view=rev
Log:
prepare for Hadoop 1.1.0-rc3
Modified:
hadoop/common/branches/branch-1.1/CHANGES.txt
hadoop/common/branches/branch-1.1/src/docs/releasenotes.html
Modified: hadoop/common/branches/branch-1.1/CHANGES.txt
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.1/CHANGES.txt?rev=1375225&r1=1375224&r2=1375225&view=diff
==============================================================================
--- hadoop/common/branches/branch-1.1/CHANGES.txt (original)
+++ hadoop/common/branches/branch-1.1/CHANGES.txt Mon Aug 20 21:21:28 2012
@@ -4,26 +4,20 @@ Release 1.1.1 - Unreleased
INCOMPATIBLE CHANGES
- HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with
- SPNEGO-based solution. (Jakob Homan, Owen O'Malley, Alejandro Abdelnur and
- Aaron T. Myers via atm)
-
NEW FEATURES
IMPROVEMENTS
- HADOOP-8656 Backport forced daemon shutdown of HADOOP-8353 into branch-1
- (Roman Shaposhnik via stevel)
-
BUG FIXES
- HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations
- to get around a Java library bug causing OutOfMemoryError. (szetszwo)
-
-Release 1.1.0 - 2012.07.09
+Release 1.1.0 - 2012.08.20
INCOMPATIBLE CHANGES
+ HDFS-2617. Replaced Kerberized SSL for image transfer and fsck with
+ SPNEGO-based solution. (Jakob Homan, Owen O'Malley, Alejandro Abdelnur and
+ Aaron T. Myers via atm)
+
HDFS-3044. fsck move should be non-destructive by default.
(Colin Patrick McCabe via eli)
@@ -58,6 +52,9 @@ Release 1.1.0 - 2012.07.09
IMPROVEMENTS
+ HADOOP-8656 Backport forced daemon shutdown of HADOOP-8353 into branch-1
+ (Roman Shaposhnik via stevel)
+
MAPREDUCE-3597. [Rumen] Provide a way to access other info of history file
from Rumen tool. (ravigummadi)
@@ -161,6 +158,9 @@ Release 1.1.0 - 2012.07.09
BUG FIXES
+ HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations
+ to get around a Java library bug causing OutOfMemoryError. (szetszwo)
+
MAPREDUCE-4087. [Gridmix] GenerateDistCacheData job of Gridmix can
become slow in some cases (ravigummadi)
Modified: hadoop/common/branches/branch-1.1/src/docs/releasenotes.html
URL: http://svn.apache.org/viewvc/hadoop/common/branches/branch-1.1/src/docs/releasenotes.html?rev=1375225&r1=1375224&r2=1375225&view=diff
==============================================================================
--- hadoop/common/branches/branch-1.1/src/docs/releasenotes.html (original)
+++ hadoop/common/branches/branch-1.1/src/docs/releasenotes.html Mon Aug 20 21:21:28 2012
@@ -146,6 +146,20 @@ dfs.datanode.readahead.bytes - set to a
</blockquote></li>
+<li> <a href="https://issues.apache.org/jira/browse/HDFS-3814">HDFS-3814</a>.
+ Major improvement reported by sureshms and fixed by jingzhao (name-node)<br>
+ <b>Make the replication monitor multipliers configurable in 1.x</b><br>
+ <blockquote> This change adds two new configuration parameters.
<br/>
+
+# {{dfs.namenode.invalidate.work.pct.per.iteration}} for controlling deletion rate of blocks.
<br/>
+
+# {{dfs.namenode.replication.work.multiplier.per.iteration}} for controlling replication rate. This in turn allows controlling the time it takes for decommissioning.
<br/>
+
+
<br/>
+
+Please see hdfs-default.xml for detailed description.
+</blockquote></li>
+
<li> <a href="https://issues.apache.org/jira/browse/MAPREDUCE-2517">MAPREDUCE-2517</a>.
Major task reported by vinaythota and fixed by vinaythota (contrib/gridmix)<br>
<b>Porting Gridmix v3 system tests into trunk branch.</b><br>
@@ -402,6 +416,11 @@ dfs.datanode.readahead.bytes - set to a
<b>Conflict: Same security.log.file for multiple users. </b><br>
<blockquote>In log4j.properties, hadoop.security.log.file is set to SecurityAuth.audit. In the presence of multiple users, this can lead to a potential conflict.<br><br>Adding username to the log file would avoid this scenario.</blockquote></li>
+<li> <a href="https://issues.apache.org/jira/browse/HADOOP-8656">HADOOP-8656</a>.
+ Minor improvement reported by stevel@apache.org and fixed by rvs (bin)<br>
+ <b>backport forced daemon shutdown of HADOOP-8353 into branch-1</b><br>
+ <blockquote>the init.d service shutdown code doesn't work if the daemon is hung -backporting the portion of HADOOP-8353 that edits bin/hadoop-daemon.sh corrects this</blockquote></li>
+
<li> <a href="https://issues.apache.org/jira/browse/HDFS-1108">HDFS-1108</a>.
Major sub-task reported by dhruba and fixed by tlipcon (ha, name-node)<br>
<b>Log newly allocated blocks</b><br>
@@ -637,6 +656,11 @@ dfs.datanode.readahead.bytes - set to a
<b>1.x: FSEditLog failure removes the wrong edit stream when storage dirs have same name</b><br>
<blockquote>In {{FSEditLog.removeEditsForStorageDir}}, we iterate over the edits streams trying to find the stream corresponding to a given dir. To check equality, we currently use the following condition:<br>{code}<br> File parentDir = getStorageDirForStream(idx);<br> if (parentDir.getName().equals(sd.getRoot().getName())) {<br>{code}<br>... which is horribly incorrect. If two or more storage dirs happen to have the same terminal path component (eg /data/1/nn and /data/2/nn) then it will pick the wrong strea...</blockquote></li>
+<li> <a href="https://issues.apache.org/jira/browse/HDFS-3696">HDFS-3696</a>.
+ Critical bug reported by kihwal and fixed by szetszwo <br>
+ <b>Create files with WebHdfsFileSystem goes OOM when file size is big</b><br>
+ <blockquote>When doing "fs -put" to a WebHdfsFileSystem (webhdfs://), the FsShell goes OOM if the file size is large. When I tested, 20MB files were fine, but 200MB didn't work. <br><br>I also tried reading a large file by issuing "-cat" and piping to a slow sink in order to force buffering. The read path didn't have this problem. The memory consumption stayed the same regardless of progress.<br></blockquote></li>
+
<li> <a href="https://issues.apache.org/jira/browse/MAPREDUCE-1740">MAPREDUCE-1740</a>.
Major bug reported by tlipcon and fixed by ahmed.radwan (jobtracker)<br>
<b>NPE in getMatchingLevelForNodes when node locations are variable depth</b><br>